Nov 06 22:21:20 user nova-compute[75000]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75000) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 22:21:20 user nova-compute[75000]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75000) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 22:21:20 user nova-compute[75000]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75000) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 22:21:20 user nova-compute[75000]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:21:21 user nova-compute[75000]: INFO nova.virt.driver [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 06 22:21:21 user nova-compute[75000]: INFO nova.compute.provider_config [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] Acquiring lock "singleton_lock" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] Acquired lock "singleton_lock" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] Releasing lock "singleton_lock" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] Full set of CONF: {{(pid=75000) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ******************************************************************************** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] Configuration options gathered from: {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ================================================================================ {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] allow_resize_to_same_host      = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] arq_binding_timeout            = 300 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] backdoor_port                  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] backdoor_socket                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] block_device_allocate_retries  = 300 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] block_device_allocate_retries_interval = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cert                           = self.pem {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute_monitors               = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] config_dir                     = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] config_drive_format            = iso9660 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] config_source                  = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] console_host                   = user {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] control_exchange               = nova {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cpu_allocation_ratio           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] daemon                         = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] debug                          = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] default_access_ip_network_name = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] default_availability_zone      = nova {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] default_ephemeral_format       = ext4 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] default_green_pool_size        = 1000 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] default_schedule_zone          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] disk_allocation_ratio          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] enable_new_services            = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] enabled_ssl_apis               = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] flat_injected                  = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] force_config_drive             = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] force_raw_images               = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] graceful_shutdown_timeout      = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] heal_instance_info_cache_interval = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] host                           = user {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] instance_build_timeout         = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] instance_delete_interval       = 300 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] instance_name_template         = instance-%08x {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] instance_usage_audit           = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] instance_usage_audit_period    = month {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] internal_service_availability_zone = internal {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] key                            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] live_migration_retry_count     = 30 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] log_config_append              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] log_dir                        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] log_file                       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] log_options                    = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] log_rotate_interval            = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] log_rotate_interval_type       = days {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] log_rotation_type              = none {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] long_rpc_timeout               = 1800 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] max_concurrent_builds          = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] max_concurrent_live_migrations = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] max_concurrent_snapshots       = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] max_local_block_devices        = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] max_logfile_count              = 30 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] max_logfile_size_mb            = 200 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] maximum_instance_delete_attempts = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] metadata_listen                = 0.0.0.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] metadata_listen_port           = 8775 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] metadata_workers               = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] migrate_max_retries            = -1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] mkisofs_cmd                    = genisoimage {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] my_ip                          = 10.0.0.210 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] network_allocate_retries       = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] osapi_compute_listen_port      = 8774 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] osapi_compute_unique_server_name_scope =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] osapi_compute_workers          = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] password_length                = 12 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] periodic_enable                = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] periodic_fuzzy_delay           = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] pointer_model                  = ps2mouse {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] preallocate_images             = none {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] publish_errors                 = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] pybasedir                      = /opt/stack/nova {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ram_allocation_ratio           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] rate_limit_burst               = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] rate_limit_except_level        = CRITICAL {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] rate_limit_interval            = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] reboot_timeout                 = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] reclaim_instance_interval      = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] record                         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] reimage_timeout_per_gb         = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] report_interval                = 120 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] rescue_timeout                 = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] reserved_host_cpus             = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] reserved_host_disk_mb          = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] reserved_host_memory_mb        = 512 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] reserved_huge_pages            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] resize_confirm_window          = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] resize_fs_using_block_device   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] resume_guests_state_on_host_boot = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] rpc_response_timeout           = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] run_external_periodic_tasks    = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] running_deleted_instance_action = reap {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] running_deleted_instance_timeout = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler_instance_sync_interval = 120 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_down_time              = 720 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] servicegroup_driver            = db {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] shelved_offload_time           = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] shelved_poll_interval          = 3600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] shutdown_timeout               = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] source_is_ipv6                 = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ssl_only                       = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] state_path                     = /opt/stack/data/nova {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] sync_power_state_interval      = 600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] sync_power_state_pool_size     = 1000 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] syslog_log_facility            = LOG_USER {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] tempdir                        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] timeout_nbd                    = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] transport_url                  = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] update_resources_interval      = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] use_cow_images                 = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] use_eventlog                   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] use_journal                    = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] use_json                       = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] use_rootwrap_daemon            = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] use_stderr                     = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] use_syslog                     = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vcpu_pin_set                   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plugging_is_fatal          = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plugging_timeout           = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] virt_mkfs                      = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] volume_usage_poll_interval     = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] watch_log_file                 = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] web                            = /usr/share/spice-html5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_concurrency.disable_process_locking = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.auth_strategy              = keystone {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.compute_link_prefix        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.dhcp_domain                = novalocal {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.enable_instance_password   = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.glance_link_prefix         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.instance_list_per_project_cells = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.list_records_by_skipping_down_cells = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.local_metadata_per_cell    = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.max_limit                  = 1000 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.metadata_cache_expiration  = 15 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.neutron_default_tenant_id  = default {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.use_forwarded_for          = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.use_neutron_default_nets   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.vendordata_dynamic_targets = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.vendordata_jsonfile_path   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.backend_argument         = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.config_prefix            = cache.oslo {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.dead_timeout             = 60.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.debug_cache_backend      = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.enable_retry_client      = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.enable_socket_keepalive  = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.enabled                  = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.expiration_time          = 600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.hashclient_retry_attempts = 2 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_dead_retry      = 300 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_password        =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_sasl_enabled    = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.memcache_username        =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.proxies                  = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.retry_attempts           = 2 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.retry_delay              = 0.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.socket_keepalive_count   = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.socket_keepalive_idle    = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.socket_keepalive_interval = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.tls_allowed_ciphers      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.tls_cafile               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.tls_certfile             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.tls_enabled              = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cache.tls_keyfile              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.auth_section            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.auth_type               = password {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.cafile                  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.certfile                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.collect_timing          = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.cross_az_attach         = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.debug                   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.endpoint_template       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.http_retries            = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.insecure                = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.keyfile                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.os_region_name          = RegionOne {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.split_loggers           = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cinder.timeout                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.cpu_dedicated_set      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.cpu_shared_set         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.image_type_exclude_list = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.resource_provider_association_refresh = 300 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.shutdown_retry_interval = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] conductor.workers              = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] console.allowed_origins        = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] console.ssl_ciphers            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] console.ssl_minimum_version    = default {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] consoleauth.token_ttl          = 600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.cafile                  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.certfile                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.collect_timing          = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.connect_retries         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.connect_retry_delay     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.endpoint_override       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.insecure                = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.keyfile                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.max_version             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.min_version             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.region_name             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.service_name            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.service_type            = accelerator {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.split_loggers           = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.status_code_retries     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.status_code_retry_delay = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.timeout                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] cyborg.version                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.backend               = sqlalchemy {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.connection            = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.connection_debug      = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.connection_parameters =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.connection_recycle_time = 3600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.connection_trace      = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.db_inc_retry_interval = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.db_max_retries        = 20 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.db_max_retry_interval = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.db_retry_interval     = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.max_overflow          = 50 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.max_pool_size         = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.max_retries           = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.mysql_wsrep_sync_wait = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.pool_timeout          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.retry_interval        = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.slave_connection      = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] database.sqlite_synchronous    = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.backend           = sqlalchemy {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.connection        = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.connection_debug  = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.connection_parameters =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.connection_recycle_time = 3600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.connection_trace  = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.db_inc_retry_interval = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.db_max_retries    = 20 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.db_max_retry_interval = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.db_retry_interval = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.max_overflow      = 50 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.max_pool_size     = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.max_retries       = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.pool_timeout      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.retry_interval    = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.slave_connection  = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] api_database.sqlite_synchronous = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] devices.enabled_mdev_types     = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ephemeral_storage_encryption.enabled = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.api_servers             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.cafile                  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.certfile                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.collect_timing          = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.connect_retries         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.connect_retry_delay     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.debug                   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.default_trusted_certificate_ids = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.enable_certificate_validation = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.enable_rbd_download     = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.endpoint_override       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.insecure                = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.keyfile                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.max_version             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.min_version             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.num_retries             = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.rbd_ceph_conf           =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.rbd_connect_timeout     = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.rbd_pool                =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.rbd_user                =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.region_name             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.service_name            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.service_type            = image {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.split_loggers           = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.status_code_retries     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.status_code_retry_delay = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.timeout                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.verify_glance_signatures = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] glance.version                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] guestfs.debug                  = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.config_drive_cdrom      = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.config_drive_inject_password = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.enable_remotefx         = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.instances_path_share    =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.limit_cpu_features      = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.use_multipath_io        = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.vswitch_name            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] mks.enabled                    = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] image_cache.manager_interval   = 2400 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] image_cache.precache_concurrency = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] image_cache.remove_unused_base_images = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] image_cache.subdirectory_name  = _base {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.api_max_retries         = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.api_retry_interval      = 2 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.auth_section            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.auth_type               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.cafile                  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.certfile                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.collect_timing          = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.conductor_group         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.connect_retries         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.connect_retry_delay     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.endpoint_override       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.insecure                = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.keyfile                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.max_version             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.min_version             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.peer_list               = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.region_name             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.serial_console_state_timeout = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.service_name            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.service_type            = baremetal {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.split_loggers           = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.status_code_retries     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.status_code_retry_delay = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.timeout                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ironic.version                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] key_manager.fixed_key          = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.barbican_api_version  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.barbican_endpoint     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.barbican_endpoint_type = public {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.barbican_region_name  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.cafile                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.certfile              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.collect_timing        = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.insecure              = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.keyfile               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.number_of_retries     = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.retry_delay           = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.send_service_user_token = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.split_loggers         = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.timeout               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.verify_ssl            = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican.verify_ssl_path       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican_service_user.auth_section = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican_service_user.auth_type = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican_service_user.cafile   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican_service_user.certfile = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican_service_user.collect_timing = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican_service_user.insecure = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican_service_user.keyfile  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican_service_user.split_loggers = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] barbican_service_user.timeout  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.approle_role_id          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.approle_secret_id        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.cafile                   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.certfile                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.collect_timing           = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.insecure                 = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.keyfile                  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.kv_mountpoint            = secret {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.kv_path                  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.kv_version               = 2 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.namespace                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.root_token_id            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.split_loggers            = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.ssl_ca_crt_file          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.timeout                  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.use_ssl                  = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.auth_section          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.auth_type             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.cafile                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.certfile              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.collect_timing        = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.connect_retries       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.connect_retry_delay   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.endpoint_override     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.insecure              = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.keyfile               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.max_version           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.min_version           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.region_name           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.service_name          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.service_type          = identity {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.split_loggers         = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.status_code_retries   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.status_code_retry_delay = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.timeout               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] keystone.version               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.connection_uri         =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.cpu_mode               = custom {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: WARNING oslo_config.cfg [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.cpu_power_governor_high = performance {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.cpu_power_management   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.device_detach_attempts = 8 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.device_detach_timeout  = 20 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.disk_cachemodes        = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.disk_prefix            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.enabled_perf_events    = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.file_backed_memory     = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.gid_maps               = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.hw_disk_discard        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.hw_machine_type        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.images_rbd_pool        = rbd {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.images_type            = default {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.images_volume_group    = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.inject_key             = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.inject_partition       = -2 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.inject_password        = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.iscsi_iface            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.iser_use_multipath     = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_downtime = 500 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_inbound_addr = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_scheme  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_timeout_action = abort {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_tunnelled = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: WARNING oslo_config.cfg [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 06 22:21:21 user nova-compute[75000]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 06 22:21:21 user nova-compute[75000]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 06 22:21:21 user nova-compute[75000]: and ``live_migration_inbound_addr`` respectively.
Nov 06 22:21:21 user nova-compute[75000]: ).  Its value may be silently ignored in the future.
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.live_migration_with_native_tls = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.max_queues             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.nfs_mount_options      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.num_pcie_ports         = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.pmem_namespaces        = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.quobyte_client_cfg     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rbd_secret_uuid        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rbd_user               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rescue_image_id        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rescue_kernel_id       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.rx_queue_size          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.smbfs_mount_options    =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.snapshot_compression   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.snapshot_image_format  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.sparse_logical_volumes = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.swtpm_enabled          = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.swtpm_group            = tss {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.swtpm_user             = tss {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.sysinfo_serial         = unique {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.tb_cache_size          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.tx_queue_size          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.uid_maps               = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.use_virtio_for_bridges = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.virt_type              = kvm {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.volume_clear           = zero {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.volume_clear_size      = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.volume_use_multipath   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.vzstorage_cache_path   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.auth_section           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.auth_type              = password {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.cafile                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.certfile               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.collect_timing         = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.connect_retries        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.connect_retry_delay    = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.default_floating_pool  = public {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.endpoint_override      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.extension_sync_interval = 600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.http_retries           = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.insecure               = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.keyfile                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.max_version            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.min_version            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.ovs_bridge             = br-int {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.physnets               = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.region_name            = RegionOne {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.service_metadata_proxy = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.service_name           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.service_type           = network {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.split_loggers          = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.status_code_retries    = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.status_code_retry_delay = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.timeout                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] neutron.version                = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] notifications.bdms_in_notifications = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] notifications.default_level    = INFO {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] notifications.notification_format = unversioned {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] notifications.notify_on_state_change = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] pci.alias                      = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] pci.device_spec                = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] pci.report_in_placement        = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.auth_section         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.auth_type            = password {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.cafile               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.certfile             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.collect_timing       = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.connect_retries      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.connect_retry_delay  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.default_domain_id    = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.default_domain_name  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.domain_id            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.domain_name          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.endpoint_override    = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.insecure             = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.keyfile              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.max_version          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.min_version          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.password             = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.project_domain_id    = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.project_domain_name  = Default {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.project_id           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.project_name         = service {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.region_name          = RegionOne {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.service_name         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.service_type         = placement {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.split_loggers        = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.status_code_retries  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.status_code_retry_delay = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.system_scope         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.timeout              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.trust_id             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.user_domain_id       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.user_domain_name     = Default {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.user_id              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.username             = placement {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] placement.version              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.cores                    = 20 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.count_usage_from_placement = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.injected_file_content_bytes = 10240 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.injected_file_path_length = 255 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.injected_files           = 5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.instances                = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.key_pairs                = 100 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.metadata_items           = 128 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.ram                      = 51200 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.recheck_quota            = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.server_group_members     = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] quota.server_groups            = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] rdp.enabled                    = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.image_metadata_prefilter = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.max_attempts         = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.max_placement_results = 1000 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] scheduler.workers              = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.host_subset_size = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.isolated_hosts = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.isolated_images = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.pci_in_placement = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.track_instance_changes = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] metrics.required               = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] metrics.weight_multiplier      = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] metrics.weight_setting         = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] serial_console.enabled         = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] serial_console.port_range      = 10000:20000 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] serial_console.serialproxy_port = 6083 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.auth_section      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.auth_type         = password {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.cafile            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.certfile          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.collect_timing    = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.insecure          = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.keyfile           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.send_service_user_token = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.split_loggers     = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] service_user.timeout           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.agent_enabled            = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.enabled                  = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.html5proxy_port          = 6082 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.image_compression        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.jpeg_compression         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.playback_compression     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.server_listen            = 127.0.0.1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.streaming_mode           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] spice.zlib_compression         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] upgrade_levels.baseapi         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] upgrade_levels.cert            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] upgrade_levels.compute         = auto {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] upgrade_levels.conductor       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] upgrade_levels.scheduler       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vendordata_dynamic_auth.cafile = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vendordata_dynamic_auth.certfile = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vendordata_dynamic_auth.insecure = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vendordata_dynamic_auth.timeout = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.api_retry_count         = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.ca_file                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.cache_prefix            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.cluster_name            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.connection_pool_size    = 10 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.console_delay_seconds   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.datastore_regex         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.host_ip                 = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.host_password           = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.host_port               = 443 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.host_username           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.insecure                = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.integration_bridge      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.maximum_objects         = 100 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.pbm_default_policy      = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.pbm_enabled             = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.pbm_wsdl_location       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.serial_port_proxy_uri   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.serial_port_service_uri = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.task_poll_interval      = 0.5 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.use_linked_clone        = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.vnc_keymap              = en-us {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.vnc_port                = 5900 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vmware.vnc_port_total          = 10000 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.auth_schemes               = ['none'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.enabled                    = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.novncproxy_port            = 6080 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.vencrypt_ca_certs          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.vencrypt_client_cert       = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vnc.vencrypt_client_key        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.disable_rootwrap   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.enable_numa_live_migration = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.libvirt_disable_apic = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.client_socket_timeout     = 900 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.default_pool_size         = 1000 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.keep_alive                = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.max_header_line           = 16384 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.ssl_ca_file               = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.ssl_cert_file             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.ssl_key_file              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.tcp_keepidle              = 600 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] zvm.ca_file                    = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] zvm.cloud_connector_url        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] zvm.reachable_timeout          = 300 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.enforce_new_defaults = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.enforce_scope      = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.policy_default_rule = default {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.connection_string     = messaging:// {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.enabled               = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.es_doc_type           = notification {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.es_scroll_size        = 10000 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.es_scroll_time        = 2m {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.filter_error_trace    = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.hmac_keys             = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.sentinel_service_name = mymaster {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.socket_timeout        = 0.1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.trace_requests        = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler.trace_sqlalchemy      = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler_jaeger.process_tags   = {} {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler_jaeger.service_name_prefix = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] profiler_otlp.service_name_prefix = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] remote_debug.host              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] remote_debug.port              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_notifications.retry = -1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.auth_section        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.auth_type           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.cafile              = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.certfile            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.collect_timing      = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.connect_retries     = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.connect_retry_delay = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.endpoint_id         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.endpoint_override   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.insecure            = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.keyfile             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.max_version         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.min_version         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.region_name         = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.service_name        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.service_type        = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.split_loggers       = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.status_code_retries = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.status_code_retry_delay = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.timeout             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.valid_interfaces    = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_limit.version             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_reports.file_event_handler = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] oslo_reports.log_dir           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_ovs_privileged.group  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] vif_plug_ovs_privileged.user   = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_ovs.isolate_vif         = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] os_brick.lock_path             = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] privsep_osbrick.capabilities   = [21] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] privsep_osbrick.group          = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] privsep_osbrick.helper_command = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] privsep_osbrick.user           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] nova_sys_admin.group           = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] nova_sys_admin.helper_command  = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] nova_sys_admin.user            = None {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG oslo_service.service [None req-a6f777c0-5c90-46fe-a39a-1b2d25b8a315 None None] ******************************************************************************** {{(pid=75000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 06 22:21:21 user nova-compute[75000]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 06 22:21:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Connecting to libvirt: qemu:///system {{(pid=75000) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7a007e2fb0> {{(pid=75000) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 06 22:21:21 user nova-compute[75000]: libvirt:  error : internal error: could not initialize domain event timer
Nov 06 22:21:21 user nova-compute[75000]: WARNING nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 06 22:21:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7a007e2fb0> {{(pid=75000) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Starting native event thread {{(pid=75000) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Starting green dispatch thread {{(pid=75000) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 06 22:21:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Starting connection event dispatch thread {{(pid=75000) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 06 22:21:21 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Connection event '1' reason 'None'
Nov 06 22:21:21 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 06 22:21:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.mount [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Initialising _HostMountState generation 0 {{(pid=75000) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 06 22:21:28 user nova-compute[75000]: INFO nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt host capabilities <capabilities>
Nov 06 22:21:28 user nova-compute[75000]:   <host>
Nov 06 22:21:28 user nova-compute[75000]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 06 22:21:28 user nova-compute[75000]:     <cpu>
Nov 06 22:21:28 user nova-compute[75000]:       <arch>x86_64</arch>
Nov 06 22:21:28 user nova-compute[75000]:       <model>IvyBridge-IBRS</model>
Nov 06 22:21:28 user nova-compute[75000]:       <vendor>Intel</vendor>
Nov 06 22:21:28 user nova-compute[75000]:       <microcode version='1070'/>
Nov 06 22:21:28 user nova-compute[75000]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 06 22:21:28 user nova-compute[75000]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='ss'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='vmx'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='pcid'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='osxsave'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='hypervisor'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='arat'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='tsc_adjust'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='md-clear'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='stibp'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='arch-capabilities'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='ssbd'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='invtsc'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='rsba'/>
Nov 06 22:21:28 user nova-compute[75000]:       <feature name='skip-l1dfl-vmentry'/>
Nov 06 22:21:28 user nova-compute[75000]:       <pages unit='KiB' size='4'/>
Nov 06 22:21:28 user nova-compute[75000]:       <pages unit='KiB' size='2048'/>
Nov 06 22:21:28 user nova-compute[75000]:     </cpu>
Nov 06 22:21:28 user nova-compute[75000]:     <power_management>
Nov 06 22:21:28 user nova-compute[75000]:       <suspend_mem/>
Nov 06 22:21:28 user nova-compute[75000]:       <suspend_disk/>
Nov 06 22:21:28 user nova-compute[75000]:       <suspend_hybrid/>
Nov 06 22:21:28 user nova-compute[75000]:     </power_management>
Nov 06 22:21:28 user nova-compute[75000]:     <iommu support='no'/>
Nov 06 22:21:28 user nova-compute[75000]:     <migration_features>
Nov 06 22:21:28 user nova-compute[75000]:       <live/>
Nov 06 22:21:28 user nova-compute[75000]:       <uri_transports>
Nov 06 22:21:28 user nova-compute[75000]:         <uri_transport>tcp</uri_transport>
Nov 06 22:21:28 user nova-compute[75000]:         <uri_transport>rdma</uri_transport>
Nov 06 22:21:28 user nova-compute[75000]:       </uri_transports>
Nov 06 22:21:28 user nova-compute[75000]:     </migration_features>
Nov 06 22:21:28 user nova-compute[75000]:     <topology>
Nov 06 22:21:28 user nova-compute[75000]:       <cells num='2'>
Nov 06 22:21:28 user nova-compute[75000]:         <cell id='0'>
Nov 06 22:21:28 user nova-compute[75000]:           <memory unit='KiB'>8140616</memory>
Nov 06 22:21:28 user nova-compute[75000]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 06 22:21:28 user nova-compute[75000]:           <pages unit='KiB' size='2048'>0</pages>
Nov 06 22:21:28 user nova-compute[75000]:           <distances>
Nov 06 22:21:28 user nova-compute[75000]:             <sibling id='0' value='10'/>
Nov 06 22:21:28 user nova-compute[75000]:             <sibling id='1' value='20'/>
Nov 06 22:21:28 user nova-compute[75000]:           </distances>
Nov 06 22:21:28 user nova-compute[75000]:           <cpus num='6'>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 06 22:21:28 user nova-compute[75000]:           </cpus>
Nov 06 22:21:28 user nova-compute[75000]:         </cell>
Nov 06 22:21:28 user nova-compute[75000]:         <cell id='1'>
Nov 06 22:21:28 user nova-compute[75000]:           <memory unit='KiB'>8255100</memory>
Nov 06 22:21:28 user nova-compute[75000]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 06 22:21:28 user nova-compute[75000]:           <pages unit='KiB' size='2048'>0</pages>
Nov 06 22:21:28 user nova-compute[75000]:           <distances>
Nov 06 22:21:28 user nova-compute[75000]:             <sibling id='0' value='20'/>
Nov 06 22:21:28 user nova-compute[75000]:             <sibling id='1' value='10'/>
Nov 06 22:21:28 user nova-compute[75000]:           </distances>
Nov 06 22:21:28 user nova-compute[75000]:           <cpus num='6'>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 06 22:21:28 user nova-compute[75000]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 06 22:21:28 user nova-compute[75000]:           </cpus>
Nov 06 22:21:28 user nova-compute[75000]:         </cell>
Nov 06 22:21:28 user nova-compute[75000]:       </cells>
Nov 06 22:21:28 user nova-compute[75000]:     </topology>
Nov 06 22:21:28 user nova-compute[75000]:     <cache>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 06 22:21:28 user nova-compute[75000]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 06 22:21:28 user nova-compute[75000]:     </cache>
Nov 06 22:21:28 user nova-compute[75000]:     <secmodel>
Nov 06 22:21:28 user nova-compute[75000]:       <model>apparmor</model>
Nov 06 22:21:28 user nova-compute[75000]:       <doi>0</doi>
Nov 06 22:21:28 user nova-compute[75000]:     </secmodel>
Nov 06 22:21:28 user nova-compute[75000]:     <secmodel>
Nov 06 22:21:29 user nova-compute[75000]:       <model>dac</model>
Nov 06 22:21:29 user nova-compute[75000]:       <doi>0</doi>
Nov 06 22:21:29 user nova-compute[75000]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 06 22:21:29 user nova-compute[75000]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 06 22:21:29 user nova-compute[75000]:     </secmodel>
Nov 06 22:21:29 user nova-compute[75000]:   </host>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='alpha'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>clipper</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='armv6l'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>spitz</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>nuri</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>kzm</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sx1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>z2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>tosa</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>n810</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>n800</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>terrier</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>midway</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>microbit</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>verdex</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>highbank</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>akita</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>connex</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>collie</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='armv7l'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>spitz</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>nuri</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>kzm</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sx1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>z2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>tosa</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>n810</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>n800</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>terrier</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>midway</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>microbit</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>verdex</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>highbank</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>akita</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>connex</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>collie</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='aarch64'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>spitz</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>nuri</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>kzm</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sx1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>z2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>tosa</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>n810</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>n800</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>terrier</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>midway</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>microbit</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>verdex</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>raspi3b</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>highbank</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>akita</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>connex</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>collie</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <acpi default='on' toggle='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='cris'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='i686'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>x-remote</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>isapc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>microvm</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='kvm'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <pae/>
Nov 06 22:21:29 user nova-compute[75000]:       <nonpae/>
Nov 06 22:21:29 user nova-compute[75000]:       <acpi default='on' toggle='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:       <apic default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='m68k'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>an5206</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>q800</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>next-cube</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='microblaze'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='microblazeel'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='mips'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='16'>malta</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='mipsel'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='16'>malta</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='mips64'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='16'>malta</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>pica61</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>magnum</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='mips64el'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='16'>malta</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>pica61</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>magnum</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='16'>boston</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='ppc'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mac99</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>40p</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>taihu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='ppc64'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2048'>powernv9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>taihu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2048'>powernv10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>40p</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mac99</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2048'>powernv8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='ppc64le'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2048'>powernv9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>taihu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2048'>powernv10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>40p</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>mac99</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2048'>powernv8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='riscv32'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='8'>spike</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>opentitan</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='5'>sifive_u</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sifive_e</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='8'>virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='riscv64'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='8'>spike</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='5'>sifive_u</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>shakti_c</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sifive_e</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='8'>virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='s390x'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='sh4'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>shix</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>r2d</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='sh4eb'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>shix</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>r2d</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='sparc'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>SS-5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>SS-20</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>LX</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>SS-4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>SS-10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>Voyager</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='sparc64'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sun4u</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>niagara</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>sun4v</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='x86_64'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>64</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>x-remote</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='1'>isapc</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>microvm</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='kvm'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <acpi default='on' toggle='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:       <apic default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='xtensa'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>sim</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>kc705</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>ml605</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>lx200</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>lx60</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]:   <guest>
Nov 06 22:21:29 user nova-compute[75000]:     <os_type>hvm</os_type>
Nov 06 22:21:29 user nova-compute[75000]:     <arch name='xtensaeb'>
Nov 06 22:21:29 user nova-compute[75000]:       <wordsize>32</wordsize>
Nov 06 22:21:29 user nova-compute[75000]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='4'>sim</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>kc705</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>ml605</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>virt</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>lx200</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>lx60</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 06 22:21:29 user nova-compute[75000]:       <domain type='qemu'/>
Nov 06 22:21:29 user nova-compute[75000]:     </arch>
Nov 06 22:21:29 user nova-compute[75000]:     <features>
Nov 06 22:21:29 user nova-compute[75000]:       <cpuselection/>
Nov 06 22:21:29 user nova-compute[75000]:       <deviceboot/>
Nov 06 22:21:29 user nova-compute[75000]:       <disksnapshot default='on' toggle='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     </features>
Nov 06 22:21:29 user nova-compute[75000]:   </guest>
Nov 06 22:21:29 user nova-compute[75000]: </capabilities>
Nov 06 22:21:29 user nova-compute[75000]: 
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 06 22:21:29 user nova-compute[75000]: <domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 22:21:29 user nova-compute[75000]:   <domain>kvm</domain>
Nov 06 22:21:29 user nova-compute[75000]:   <machine>pc-q35-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:   <arch>i686</arch>
Nov 06 22:21:29 user nova-compute[75000]:   <vcpu max='288'/>
Nov 06 22:21:29 user nova-compute[75000]:   <iothreads supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:   <os supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='firmware'/>
Nov 06 22:21:29 user nova-compute[75000]:     <loader supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>rom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pflash</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='readonly'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='secure'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </loader>
Nov 06 22:21:29 user nova-compute[75000]:   </os>
Nov 06 22:21:29 user nova-compute[75000]:   <cpu>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-passthrough' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='hostPassthroughMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='maximum' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='maximumMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-model' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <vendor>Intel</vendor>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ss'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='vmx'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pcid'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='hypervisor'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arat'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='umip'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='md-clear'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibpb'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibrs'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='erms'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='lm'/>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='custom' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>qemu64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>qemu32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>phenom</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>n270</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>kvm64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>coreduo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>core2duo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>athlon</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Westmere</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Snowridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Penryn</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G5</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G4</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G1</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Nehalem</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Rome</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Milan</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Dhyana</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cooperlake</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Conroe</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>486</model>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:   </cpu>
Nov 06 22:21:29 user nova-compute[75000]:   <memoryBacking supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='sourceType'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>file</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>anonymous</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>memfd</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:   </memoryBacking>
Nov 06 22:21:29 user nova-compute[75000]:   <devices>
Nov 06 22:21:29 user nova-compute[75000]:     <disk supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='diskDevice'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>disk</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cdrom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>floppy</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>lun</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='bus'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>fdc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sata</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </disk>
Nov 06 22:21:29 user nova-compute[75000]:     <graphics supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sdl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vnc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>spice</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egl-headless</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </graphics>
Nov 06 22:21:29 user nova-compute[75000]:     <video supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='modelType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cirrus</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vmvga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>qxl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>none</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>bochs</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ramfb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </video>
Nov 06 22:21:29 user nova-compute[75000]:     <hostdev supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='mode'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>subsystem</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='startupPolicy'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>default</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>mandatory</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>requisite</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>optional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='subsysType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pci</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='capsType'/>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='pciBackend'/>
Nov 06 22:21:29 user nova-compute[75000]:     </hostdev>
Nov 06 22:21:29 user nova-compute[75000]:     <rng supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>random</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egd</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>builtin</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </rng>
Nov 06 22:21:29 user nova-compute[75000]:     <filesystem supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='driverType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>path</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>handle</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtiofs</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </filesystem>
Nov 06 22:21:29 user nova-compute[75000]:     <tpm supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-tis</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-crb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>passthrough</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>emulator</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </tpm>
Nov 06 22:21:29 user nova-compute[75000]:   </devices>
Nov 06 22:21:29 user nova-compute[75000]:   <features>
Nov 06 22:21:29 user nova-compute[75000]:     <gic supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     <vmcoreinfo supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <genid supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backingStoreInput supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backup supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <sev supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:   </features>
Nov 06 22:21:29 user nova-compute[75000]: </domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:  {{(pid=75000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 06 22:21:29 user nova-compute[75000]: <domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 22:21:29 user nova-compute[75000]:   <domain>kvm</domain>
Nov 06 22:21:29 user nova-compute[75000]:   <machine>pc-q35-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:   <arch>i686</arch>
Nov 06 22:21:29 user nova-compute[75000]:   <vcpu max='288'/>
Nov 06 22:21:29 user nova-compute[75000]:   <iothreads supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:   <os supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='firmware'/>
Nov 06 22:21:29 user nova-compute[75000]:     <loader supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>rom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pflash</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='readonly'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='secure'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </loader>
Nov 06 22:21:29 user nova-compute[75000]:   </os>
Nov 06 22:21:29 user nova-compute[75000]:   <cpu>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-passthrough' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='hostPassthroughMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='maximum' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='maximumMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-model' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <vendor>Intel</vendor>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ss'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='vmx'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pcid'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='hypervisor'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arat'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='umip'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='md-clear'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibpb'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibrs'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='erms'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='lm'/>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='custom' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>qemu64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>qemu32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>phenom</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>n270</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>kvm64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>coreduo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>core2duo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>athlon</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Westmere</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Snowridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Penryn</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G5</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G4</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G1</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Nehalem</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Rome</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Milan</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Dhyana</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cooperlake</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Conroe</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>486</model>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:   </cpu>
Nov 06 22:21:29 user nova-compute[75000]:   <memoryBacking supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='sourceType'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>file</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>anonymous</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>memfd</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:   </memoryBacking>
Nov 06 22:21:29 user nova-compute[75000]:   <devices>
Nov 06 22:21:29 user nova-compute[75000]:     <disk supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='diskDevice'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>disk</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cdrom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>floppy</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>lun</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='bus'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>fdc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sata</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </disk>
Nov 06 22:21:29 user nova-compute[75000]:     <graphics supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sdl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vnc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>spice</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egl-headless</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </graphics>
Nov 06 22:21:29 user nova-compute[75000]:     <video supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='modelType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cirrus</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vmvga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>qxl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>none</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>bochs</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ramfb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </video>
Nov 06 22:21:29 user nova-compute[75000]:     <hostdev supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='mode'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>subsystem</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='startupPolicy'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>default</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>mandatory</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>requisite</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>optional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='subsysType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pci</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='capsType'/>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='pciBackend'/>
Nov 06 22:21:29 user nova-compute[75000]:     </hostdev>
Nov 06 22:21:29 user nova-compute[75000]:     <rng supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>random</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egd</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>builtin</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </rng>
Nov 06 22:21:29 user nova-compute[75000]:     <filesystem supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='driverType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>path</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>handle</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtiofs</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </filesystem>
Nov 06 22:21:29 user nova-compute[75000]:     <tpm supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-tis</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-crb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>passthrough</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>emulator</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </tpm>
Nov 06 22:21:29 user nova-compute[75000]:   </devices>
Nov 06 22:21:29 user nova-compute[75000]:   <features>
Nov 06 22:21:29 user nova-compute[75000]:     <gic supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     <vmcoreinfo supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <genid supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backingStoreInput supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backup supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <sev supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:   </features>
Nov 06 22:21:29 user nova-compute[75000]: </domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:  {{(pid=75000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 06 22:21:29 user nova-compute[75000]: <domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 22:21:29 user nova-compute[75000]:   <domain>kvm</domain>
Nov 06 22:21:29 user nova-compute[75000]:   <machine>pc-i440fx-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:   <arch>i686</arch>
Nov 06 22:21:29 user nova-compute[75000]:   <vcpu max='255'/>
Nov 06 22:21:29 user nova-compute[75000]:   <iothreads supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:   <os supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='firmware'/>
Nov 06 22:21:29 user nova-compute[75000]:     <loader supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>rom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pflash</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='readonly'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='secure'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </loader>
Nov 06 22:21:29 user nova-compute[75000]:   </os>
Nov 06 22:21:29 user nova-compute[75000]:   <cpu>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-passthrough' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='hostPassthroughMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='maximum' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='maximumMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-model' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <vendor>Intel</vendor>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ss'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='vmx'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pcid'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='hypervisor'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arat'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='umip'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='md-clear'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibpb'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibrs'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='erms'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='lm'/>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='custom' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>qemu64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>qemu32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>phenom</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>n270</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>kvm64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>coreduo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>core2duo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>athlon</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Westmere</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Snowridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Penryn</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G5</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G4</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G1</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Nehalem</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Rome</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Milan</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Dhyana</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cooperlake</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Conroe</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>486</model>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:   </cpu>
Nov 06 22:21:29 user nova-compute[75000]:   <memoryBacking supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='sourceType'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>file</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>anonymous</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>memfd</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:   </memoryBacking>
Nov 06 22:21:29 user nova-compute[75000]:   <devices>
Nov 06 22:21:29 user nova-compute[75000]:     <disk supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='diskDevice'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>disk</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cdrom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>floppy</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>lun</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='bus'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ide</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>fdc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sata</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </disk>
Nov 06 22:21:29 user nova-compute[75000]:     <graphics supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sdl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vnc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>spice</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egl-headless</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </graphics>
Nov 06 22:21:29 user nova-compute[75000]:     <video supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='modelType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cirrus</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vmvga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>qxl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>none</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>bochs</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ramfb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </video>
Nov 06 22:21:29 user nova-compute[75000]:     <hostdev supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='mode'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>subsystem</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='startupPolicy'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>default</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>mandatory</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>requisite</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>optional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='subsysType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pci</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='capsType'/>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='pciBackend'/>
Nov 06 22:21:29 user nova-compute[75000]:     </hostdev>
Nov 06 22:21:29 user nova-compute[75000]:     <rng supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>random</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egd</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>builtin</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </rng>
Nov 06 22:21:29 user nova-compute[75000]:     <filesystem supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='driverType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>path</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>handle</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtiofs</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </filesystem>
Nov 06 22:21:29 user nova-compute[75000]:     <tpm supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-tis</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-crb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>passthrough</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>emulator</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </tpm>
Nov 06 22:21:29 user nova-compute[75000]:   </devices>
Nov 06 22:21:29 user nova-compute[75000]:   <features>
Nov 06 22:21:29 user nova-compute[75000]:     <gic supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     <vmcoreinfo supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <genid supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backingStoreInput supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backup supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <sev supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:   </features>
Nov 06 22:21:29 user nova-compute[75000]: </domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:  {{(pid=75000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 06 22:21:29 user nova-compute[75000]: <domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 22:21:29 user nova-compute[75000]:   <domain>kvm</domain>
Nov 06 22:21:29 user nova-compute[75000]:   <machine>pc-i440fx-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:   <arch>i686</arch>
Nov 06 22:21:29 user nova-compute[75000]:   <vcpu max='255'/>
Nov 06 22:21:29 user nova-compute[75000]:   <iothreads supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:   <os supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='firmware'/>
Nov 06 22:21:29 user nova-compute[75000]:     <loader supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>rom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pflash</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='readonly'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='secure'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </loader>
Nov 06 22:21:29 user nova-compute[75000]:   </os>
Nov 06 22:21:29 user nova-compute[75000]:   <cpu>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-passthrough' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='hostPassthroughMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='maximum' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='maximumMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-model' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <vendor>Intel</vendor>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ss'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='vmx'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pcid'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='hypervisor'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arat'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='umip'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='md-clear'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibpb'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibrs'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='erms'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='lm'/>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='custom' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>qemu64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>qemu32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>phenom</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>n270</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>kvm64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>coreduo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>core2duo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>athlon</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Westmere</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Snowridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Penryn</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G5</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G4</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G1</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Nehalem</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Rome</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Milan</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Dhyana</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cooperlake</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Conroe</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>486</model>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:   </cpu>
Nov 06 22:21:29 user nova-compute[75000]:   <memoryBacking supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='sourceType'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>file</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>anonymous</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>memfd</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:   </memoryBacking>
Nov 06 22:21:29 user nova-compute[75000]:   <devices>
Nov 06 22:21:29 user nova-compute[75000]:     <disk supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='diskDevice'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>disk</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cdrom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>floppy</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>lun</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='bus'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ide</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>fdc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sata</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </disk>
Nov 06 22:21:29 user nova-compute[75000]:     <graphics supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sdl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vnc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>spice</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egl-headless</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </graphics>
Nov 06 22:21:29 user nova-compute[75000]:     <video supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='modelType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cirrus</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vmvga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>qxl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>none</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>bochs</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ramfb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </video>
Nov 06 22:21:29 user nova-compute[75000]:     <hostdev supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='mode'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>subsystem</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='startupPolicy'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>default</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>mandatory</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>requisite</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>optional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='subsysType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pci</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='capsType'/>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='pciBackend'/>
Nov 06 22:21:29 user nova-compute[75000]:     </hostdev>
Nov 06 22:21:29 user nova-compute[75000]:     <rng supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>random</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egd</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>builtin</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </rng>
Nov 06 22:21:29 user nova-compute[75000]:     <filesystem supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='driverType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>path</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>handle</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtiofs</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </filesystem>
Nov 06 22:21:29 user nova-compute[75000]:     <tpm supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-tis</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-crb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>passthrough</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>emulator</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </tpm>
Nov 06 22:21:29 user nova-compute[75000]:   </devices>
Nov 06 22:21:29 user nova-compute[75000]:   <features>
Nov 06 22:21:29 user nova-compute[75000]:     <gic supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     <vmcoreinfo supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <genid supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backingStoreInput supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backup supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <sev supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:   </features>
Nov 06 22:21:29 user nova-compute[75000]: </domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:  {{(pid=75000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 06 22:21:29 user nova-compute[75000]: <domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 22:21:29 user nova-compute[75000]:   <domain>kvm</domain>
Nov 06 22:21:29 user nova-compute[75000]:   <machine>pc-q35-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:   <arch>x86_64</arch>
Nov 06 22:21:29 user nova-compute[75000]:   <vcpu max='288'/>
Nov 06 22:21:29 user nova-compute[75000]:   <iothreads supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:   <os supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='firmware'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>efi</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:     <loader supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>rom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pflash</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='readonly'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='secure'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </loader>
Nov 06 22:21:29 user nova-compute[75000]:   </os>
Nov 06 22:21:29 user nova-compute[75000]:   <cpu>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-passthrough' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='hostPassthroughMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='maximum' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='maximumMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-model' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <vendor>Intel</vendor>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ss'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='vmx'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pcid'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='hypervisor'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arat'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='umip'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='md-clear'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='invtsc'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibpb'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibrs'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='rsba'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='erms'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='custom' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>qemu64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>qemu32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>phenom</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>n270</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>coreduo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>core2duo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>athlon</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Westmere</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Snowridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Penryn</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G5</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G4</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Opteron_G1</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Nehalem</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Rome</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Milan</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Dhyana</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cooperlake</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Conroe</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>486</model>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:   </cpu>
Nov 06 22:21:29 user nova-compute[75000]:   <memoryBacking supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='sourceType'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>file</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>anonymous</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>memfd</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:   </memoryBacking>
Nov 06 22:21:29 user nova-compute[75000]:   <devices>
Nov 06 22:21:29 user nova-compute[75000]:     <disk supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='diskDevice'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>disk</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cdrom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>floppy</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>lun</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='bus'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>fdc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sata</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </disk>
Nov 06 22:21:29 user nova-compute[75000]:     <graphics supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sdl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vnc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>spice</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egl-headless</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </graphics>
Nov 06 22:21:29 user nova-compute[75000]:     <video supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='modelType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cirrus</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vmvga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>qxl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>none</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>bochs</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ramfb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </video>
Nov 06 22:21:29 user nova-compute[75000]:     <hostdev supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='mode'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>subsystem</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='startupPolicy'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>default</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>mandatory</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>requisite</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>optional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='subsysType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pci</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='capsType'/>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='pciBackend'/>
Nov 06 22:21:29 user nova-compute[75000]:     </hostdev>
Nov 06 22:21:29 user nova-compute[75000]:     <rng supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>random</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egd</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>builtin</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </rng>
Nov 06 22:21:29 user nova-compute[75000]:     <filesystem supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='driverType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>path</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>handle</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtiofs</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </filesystem>
Nov 06 22:21:29 user nova-compute[75000]:     <tpm supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-tis</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-crb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>passthrough</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>emulator</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </tpm>
Nov 06 22:21:29 user nova-compute[75000]:   </devices>
Nov 06 22:21:29 user nova-compute[75000]:   <features>
Nov 06 22:21:29 user nova-compute[75000]:     <gic supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     <vmcoreinfo supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <genid supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backingStoreInput supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backup supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <sev supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:   </features>
Nov 06 22:21:29 user nova-compute[75000]: </domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:  {{(pid=75000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 06 22:21:29 user nova-compute[75000]: <domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 22:21:29 user nova-compute[75000]:   <domain>kvm</domain>
Nov 06 22:21:29 user nova-compute[75000]:   <machine>pc-q35-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:   <arch>x86_64</arch>
Nov 06 22:21:29 user nova-compute[75000]:   <vcpu max='288'/>
Nov 06 22:21:29 user nova-compute[75000]:   <iothreads supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:   <os supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='firmware'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>efi</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:     <loader supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>rom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pflash</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='readonly'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='secure'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </loader>
Nov 06 22:21:29 user nova-compute[75000]:   </os>
Nov 06 22:21:29 user nova-compute[75000]:   <cpu>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-passthrough' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='hostPassthroughMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='maximum' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='maximumMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-model' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <vendor>Intel</vendor>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ss'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='vmx'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pcid'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='hypervisor'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arat'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='umip'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='md-clear'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='invtsc'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibpb'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibrs'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='rsba'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='erms'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='custom' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>qemu64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>qemu32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>phenom</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>n270</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>coreduo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>core2duo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>athlon</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Westmere</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Snowridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Penryn</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G5</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G4</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Opteron_G1</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Nehalem</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Rome</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Milan</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Dhyana</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cooperlake</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Conroe</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>486</model>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:   </cpu>
Nov 06 22:21:29 user nova-compute[75000]:   <memoryBacking supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='sourceType'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>file</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>anonymous</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>memfd</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:   </memoryBacking>
Nov 06 22:21:29 user nova-compute[75000]:   <devices>
Nov 06 22:21:29 user nova-compute[75000]:     <disk supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='diskDevice'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>disk</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cdrom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>floppy</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>lun</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='bus'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>fdc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sata</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </disk>
Nov 06 22:21:29 user nova-compute[75000]:     <graphics supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sdl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vnc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>spice</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egl-headless</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </graphics>
Nov 06 22:21:29 user nova-compute[75000]:     <video supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='modelType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cirrus</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vmvga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>qxl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>none</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>bochs</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ramfb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </video>
Nov 06 22:21:29 user nova-compute[75000]:     <hostdev supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='mode'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>subsystem</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='startupPolicy'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>default</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>mandatory</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>requisite</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>optional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='subsysType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pci</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='capsType'/>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='pciBackend'/>
Nov 06 22:21:29 user nova-compute[75000]:     </hostdev>
Nov 06 22:21:29 user nova-compute[75000]:     <rng supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>random</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egd</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>builtin</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </rng>
Nov 06 22:21:29 user nova-compute[75000]:     <filesystem supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='driverType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>path</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>handle</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtiofs</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </filesystem>
Nov 06 22:21:29 user nova-compute[75000]:     <tpm supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-tis</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-crb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>passthrough</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>emulator</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </tpm>
Nov 06 22:21:29 user nova-compute[75000]:   </devices>
Nov 06 22:21:29 user nova-compute[75000]:   <features>
Nov 06 22:21:29 user nova-compute[75000]:     <gic supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     <vmcoreinfo supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <genid supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backingStoreInput supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backup supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <sev supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:   </features>
Nov 06 22:21:29 user nova-compute[75000]: </domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:  {{(pid=75000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 06 22:21:29 user nova-compute[75000]: <domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 22:21:29 user nova-compute[75000]:   <domain>kvm</domain>
Nov 06 22:21:29 user nova-compute[75000]:   <machine>pc-i440fx-jammy</machine>
Nov 06 22:21:29 user nova-compute[75000]:   <arch>x86_64</arch>
Nov 06 22:21:29 user nova-compute[75000]:   <vcpu max='255'/>
Nov 06 22:21:29 user nova-compute[75000]:   <iothreads supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:   <os supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='firmware'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>efi</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:     <loader supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>rom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pflash</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='readonly'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='secure'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </loader>
Nov 06 22:21:29 user nova-compute[75000]:   </os>
Nov 06 22:21:29 user nova-compute[75000]:   <cpu>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-passthrough' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='hostPassthroughMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='maximum' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='maximumMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-model' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <vendor>Intel</vendor>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ss'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='vmx'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pcid'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='hypervisor'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arat'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='umip'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='md-clear'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='invtsc'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibpb'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibrs'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='rsba'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='erms'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='custom' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>qemu64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>qemu32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>phenom</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>n270</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>coreduo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>core2duo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>athlon</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Westmere</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Snowridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Penryn</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G5</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G4</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Opteron_G1</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Nehalem</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Rome</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Milan</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Dhyana</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cooperlake</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Conroe</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>486</model>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:   </cpu>
Nov 06 22:21:29 user nova-compute[75000]:   <memoryBacking supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='sourceType'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>file</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>anonymous</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>memfd</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:   </memoryBacking>
Nov 06 22:21:29 user nova-compute[75000]:   <devices>
Nov 06 22:21:29 user nova-compute[75000]:     <disk supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='diskDevice'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>disk</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cdrom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>floppy</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>lun</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='bus'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ide</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>fdc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sata</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </disk>
Nov 06 22:21:29 user nova-compute[75000]:     <graphics supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sdl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vnc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>spice</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egl-headless</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </graphics>
Nov 06 22:21:29 user nova-compute[75000]:     <video supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='modelType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cirrus</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vmvga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>qxl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>none</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>bochs</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ramfb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </video>
Nov 06 22:21:29 user nova-compute[75000]:     <hostdev supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='mode'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>subsystem</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='startupPolicy'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>default</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>mandatory</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>requisite</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>optional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='subsysType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pci</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='capsType'/>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='pciBackend'/>
Nov 06 22:21:29 user nova-compute[75000]:     </hostdev>
Nov 06 22:21:29 user nova-compute[75000]:     <rng supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>random</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egd</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>builtin</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </rng>
Nov 06 22:21:29 user nova-compute[75000]:     <filesystem supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='driverType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>path</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>handle</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtiofs</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </filesystem>
Nov 06 22:21:29 user nova-compute[75000]:     <tpm supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-tis</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-crb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>passthrough</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>emulator</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </tpm>
Nov 06 22:21:29 user nova-compute[75000]:   </devices>
Nov 06 22:21:29 user nova-compute[75000]:   <features>
Nov 06 22:21:29 user nova-compute[75000]:     <gic supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     <vmcoreinfo supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <genid supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backingStoreInput supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backup supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <sev supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:   </features>
Nov 06 22:21:29 user nova-compute[75000]: </domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:  {{(pid=75000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 06 22:21:29 user nova-compute[75000]: <domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 22:21:29 user nova-compute[75000]:   <domain>kvm</domain>
Nov 06 22:21:29 user nova-compute[75000]:   <machine>pc-i440fx-6.2</machine>
Nov 06 22:21:29 user nova-compute[75000]:   <arch>x86_64</arch>
Nov 06 22:21:29 user nova-compute[75000]:   <vcpu max='255'/>
Nov 06 22:21:29 user nova-compute[75000]:   <iothreads supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:   <os supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='firmware'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>efi</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:     <loader supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>rom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pflash</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='readonly'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>yes</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='secure'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>no</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </loader>
Nov 06 22:21:29 user nova-compute[75000]:   </os>
Nov 06 22:21:29 user nova-compute[75000]:   <cpu>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-passthrough' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='hostPassthroughMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='maximum' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='maximumMigratable'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>on</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>off</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='host-model' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <vendor>Intel</vendor>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ss'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='vmx'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pcid'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='hypervisor'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arat'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='umip'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='md-clear'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='invtsc'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibpb'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='ibrs'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-stibp'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='rsba'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='erms'/>
Nov 06 22:21:29 user nova-compute[75000]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:     <mode name='custom' supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>qemu64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>qemu32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>phenom</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>pentium</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>n270</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm64</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>kvm32</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>coreduo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>core2duo</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>athlon</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Westmere</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Snowridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Skylake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>SandyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Penryn</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G5</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G4</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G3</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Opteron_G2</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Opteron_G1</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Nehalem</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>IvyBridge</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Icelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Haswell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Rome</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-Milan</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>EPYC</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Dhyana</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cooperlake</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>Conroe</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='no'>Broadwell</model>
Nov 06 22:21:29 user nova-compute[75000]:       <model usable='yes'>486</model>
Nov 06 22:21:29 user nova-compute[75000]:     </mode>
Nov 06 22:21:29 user nova-compute[75000]:   </cpu>
Nov 06 22:21:29 user nova-compute[75000]:   <memoryBacking supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:     <enum name='sourceType'>
Nov 06 22:21:29 user nova-compute[75000]:       <value>file</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>anonymous</value>
Nov 06 22:21:29 user nova-compute[75000]:       <value>memfd</value>
Nov 06 22:21:29 user nova-compute[75000]:     </enum>
Nov 06 22:21:29 user nova-compute[75000]:   </memoryBacking>
Nov 06 22:21:29 user nova-compute[75000]:   <devices>
Nov 06 22:21:29 user nova-compute[75000]:     <disk supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='diskDevice'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>disk</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cdrom</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>floppy</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>lun</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='bus'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ide</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>fdc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sata</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </disk>
Nov 06 22:21:29 user nova-compute[75000]:     <graphics supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='type'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>sdl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vnc</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>spice</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egl-headless</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </graphics>
Nov 06 22:21:29 user nova-compute[75000]:     <video supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='modelType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>cirrus</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>vmvga</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>qxl</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>none</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>bochs</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>ramfb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </video>
Nov 06 22:21:29 user nova-compute[75000]:     <hostdev supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='mode'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>subsystem</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='startupPolicy'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>default</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>mandatory</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>requisite</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>optional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='subsysType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>usb</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>pci</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>scsi</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='capsType'/>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='pciBackend'/>
Nov 06 22:21:29 user nova-compute[75000]:     </hostdev>
Nov 06 22:21:29 user nova-compute[75000]:     <rng supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtio-non-transitional</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>random</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>egd</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>builtin</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </rng>
Nov 06 22:21:29 user nova-compute[75000]:     <filesystem supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='driverType'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>path</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>handle</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>virtiofs</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </filesystem>
Nov 06 22:21:29 user nova-compute[75000]:     <tpm supported='yes'>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='model'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-tis</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>tpm-crb</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:       <enum name='backendModel'>
Nov 06 22:21:29 user nova-compute[75000]:         <value>passthrough</value>
Nov 06 22:21:29 user nova-compute[75000]:         <value>emulator</value>
Nov 06 22:21:29 user nova-compute[75000]:       </enum>
Nov 06 22:21:29 user nova-compute[75000]:     </tpm>
Nov 06 22:21:29 user nova-compute[75000]:   </devices>
Nov 06 22:21:29 user nova-compute[75000]:   <features>
Nov 06 22:21:29 user nova-compute[75000]:     <gic supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:     <vmcoreinfo supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <genid supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backingStoreInput supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <backup supported='yes'/>
Nov 06 22:21:29 user nova-compute[75000]:     <sev supported='no'/>
Nov 06 22:21:29 user nova-compute[75000]:   </features>
Nov 06 22:21:29 user nova-compute[75000]: </domainCapabilities>
Nov 06 22:21:29 user nova-compute[75000]:  {{(pid=75000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Checking secure boot support for host arch (x86_64) {{(pid=75000) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 06 22:21:29 user nova-compute[75000]: INFO nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Secure Boot support detected
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] cpu compare xml: <cpu match="exact">
Nov 06 22:21:29 user nova-compute[75000]:   <model>Nehalem</model>
Nov 06 22:21:29 user nova-compute[75000]: </cpu>
Nov 06 22:21:29 user nova-compute[75000]:  {{(pid=75000) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 06 22:21:29 user nova-compute[75000]: INFO nova.virt.node [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Generated node identity 41c3d89d-3143-4eef-b1f4-8f3c2c4411da
Nov 06 22:21:29 user nova-compute[75000]: INFO nova.virt.node [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Wrote node identity 41c3d89d-3143-4eef-b1f4-8f3c2c4411da to /opt/stack/data/nova/compute_id
Nov 06 22:21:29 user nova-compute[75000]: WARNING nova.compute.manager [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Compute nodes ['41c3d89d-3143-4eef-b1f4-8f3c2c4411da'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 06 22:21:29 user nova-compute[75000]: INFO nova.compute.manager [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 06 22:21:29 user nova-compute[75000]: WARNING nova.compute.manager [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 06 22:21:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:21:29 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:21:29 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Hypervisor/Node resource view: name=user free_ram=11024MB free_disk=26.0411376953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:21:29 user nova-compute[75000]: WARNING nova.compute.resource_tracker [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] No compute node record for user:41c3d89d-3143-4eef-b1f4-8f3c2c4411da: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 41c3d89d-3143-4eef-b1f4-8f3c2c4411da could not be found.
Nov 06 22:21:29 user nova-compute[75000]: INFO nova.compute.resource_tracker [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Compute node record created for user:user with uuid: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:21:29 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:21:29 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] [req-f7116fb4-89c1-46ad-b75f-9aa9f751d68e] Created resource provider record via placement API for resource provider with UUID 41c3d89d-3143-4eef-b1f4-8f3c2c4411da and name user.
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75000) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 06 22:21:30 user nova-compute[75000]: INFO nova.virt.libvirt.host [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] kernel doesn't support AMD SEV
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Libvirt baseline CPU <cpu>
Nov 06 22:21:30 user nova-compute[75000]:   <arch>x86_64</arch>
Nov 06 22:21:30 user nova-compute[75000]:   <model>Nehalem</model>
Nov 06 22:21:30 user nova-compute[75000]:   <vendor>Intel</vendor>
Nov 06 22:21:30 user nova-compute[75000]:   <topology sockets="6" cores="1" threads="1"/>
Nov 06 22:21:30 user nova-compute[75000]: </cpu>
Nov 06 22:21:30 user nova-compute[75000]:  {{(pid=75000) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Updated inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Updating resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da generation from 0 to 1 during operation: update_inventory {{(pid=75000) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Updating resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da generation from 1 to 2 during operation: update_traits {{(pid=75000) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.service [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Creating RPC server for service compute {{(pid=75000) start /opt/stack/nova/nova/service.py:182}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.service [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] Join ServiceGroup membership for this service compute {{(pid=75000) start /opt/stack/nova/nova/service.py:199}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG nova.servicegroup.drivers.db [None req-c697c897-9a4c-4e32-b8f0-3080f33d53be None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75000) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:21:30 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:22:21 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:22:21 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=10456MB free_disk=25.94497299194336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:22:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:23:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:23:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:23:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 22:23:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:23:22 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:23:22 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:23:22 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=10385MB free_disk=26.009044647216797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:23:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:23:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:23:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:24:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:24:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:24:22 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:24:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:24:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:24:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:24:23 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:24:23 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:24:23 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=10388MB free_disk=25.762863159179688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:24:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.096s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:24:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:24:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:24:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:24:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:24:25 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:22 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:25:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:25:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 22:25:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:25:24 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:24 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:24 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=9648MB free_disk=25.790821075439453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:25:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:25 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:25:31 user nova-compute[75000]: INFO nova.compute.claims [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Claim successful on node user
Nov 06 22:25:31 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:25:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:25:31 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:25:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:25:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:25:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:25:32 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Creating image(s)
Nov 06 22:25:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "/opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "/opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:32 user nova-compute[75000]: DEBUG nova.policy [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddbbf039233142eca9f4cdfe2396da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a8c838f784f309fb9f0066e3463ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:25:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:33 user nova-compute[75000]: DEBUG nova.virt.images [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] cf3cd688-ea7b-402f-a42c-d141d8f6e4e9 was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 22:25:33 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:25:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9.part /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9.part /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9.converted" returned: 0 in 0.266s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.319s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:33 user nova-compute[75000]: INFO oslo.privsep.daemon [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpk5f6h6b1/privsep.sock']
Nov 06 22:25:33 user sudo[84392]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpk5f6h6b1/privsep.sock
Nov 06 22:25:33 user sudo[84392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 22:25:34 user nova-compute[75000]: DEBUG nova.network.neutron [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Successfully created port: af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "acb2e909-770b-4cc5-822f-885cca107e1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:25:34 user nova-compute[75000]: INFO nova.compute.claims [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Claim successful on node user
Nov 06 22:25:34 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:25:34 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:25:34 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:25:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:25:34 user sudo[84392]: pam_unix(sudo:session): session closed for user root
Nov 06 22:25:34 user nova-compute[75000]: INFO oslo.privsep.daemon [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Spawned new privsep daemon via rootwrap
Nov 06 22:25:34 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 22:25:34 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 22:25:34 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 06 22:25:34 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84485
Nov 06 22:25:35 user nova-compute[75000]: DEBUG nova.policy [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f0b714b7d304fbaa4b2c4252fbaecbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4814d9e29ed84398857e2d6d26d8dd7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:25:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Creating image(s)
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "/opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "/opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "/opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.214s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.241s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk 1073741824" returned: 0 in 0.049s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.229s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.160s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.159s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk 1073741824" returned: 0 in 0.053s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Cannot resize image /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Ensure instance console log exists: /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Cannot resize image /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Ensure instance console log exists: /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:36 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Successfully created port: 97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:25:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Successfully updated port: af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:25:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquired lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:25:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:25:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-426213a6-1a9a-427f-96b3-438dc8aff081 req-17227240-558f-456c-ab3c-9a18322662ec service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received event network-changed-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-426213a6-1a9a-427f-96b3-438dc8aff081 req-17227240-558f-456c-ab3c-9a18322662ec service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Refreshing instance network info cache due to event network-changed-af573ad3-e075-4cd4-83e1-d9fb02479076. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:25:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-426213a6-1a9a-427f-96b3-438dc8aff081 req-17227240-558f-456c-ab3c-9a18322662ec service nova] Acquiring lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "97e834ec-a286-4da9-a6b8-164a1061f042" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "97e834ec-a286-4da9-a6b8-164a1061f042" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Successfully updated port: 97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "refresh_cache-acb2e909-770b-4cc5-822f-885cca107e1c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquired lock "refresh_cache-acb2e909-770b-4cc5-822f-885cca107e1c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:25:38 user nova-compute[75000]: INFO nova.compute.claims [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Claim successful on node user
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-28b57b0a-39b4-4e6f-ab2e-4c26a5e0d8d3 req-5d7996ef-d25f-4234-98c5-85624315356d service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received event network-changed-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-28b57b0a-39b4-4e6f-ab2e-4c26a5e0d8d3 req-5d7996ef-d25f-4234-98c5-85624315356d service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Refreshing instance network info cache due to event network-changed-97af2be1-4e4d-414a-9233-ff6f508ebded. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-28b57b0a-39b4-4e6f-ab2e-4c26a5e0d8d3 req-5d7996ef-d25f-4234-98c5-85624315356d service nova] Acquiring lock "refresh_cache-acb2e909-770b-4cc5-822f-885cca107e1c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updating instance_info_cache with network_info: [{"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Releasing lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Instance network_info: |[{"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-426213a6-1a9a-427f-96b3-438dc8aff081 req-17227240-558f-456c-ab3c-9a18322662ec service nova] Acquired lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.neutron [req-426213a6-1a9a-427f-96b3-438dc8aff081 req-17227240-558f-456c-ab3c-9a18322662ec service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Refreshing network info cache for port af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Start _get_guest_xml network_info=[{"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:25:38 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:38 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1449310249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1449310249',id=1,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-p0wxclnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:32Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=bf3bafdf-dba5-4961-a891-98f522b27f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:1e:11,bridge_name='br-int',has_traffic_filtering=True,id=af573ad3-e075-4cd4-83e1-d9fb02479076,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf573ad3-e0') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.objects.instance [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'pci_devices' on Instance uuid bf3bafdf-dba5-4961-a891-98f522b27f53 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:25:38 user nova-compute[75000]:   <uuid>bf3bafdf-dba5-4961-a891-98f522b27f53</uuid>
Nov 06 22:25:38 user nova-compute[75000]:   <name>instance-00000001</name>
Nov 06 22:25:38 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:25:38 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:25:38 user nova-compute[75000]:   <metadata>
Nov 06 22:25:38 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:25:38 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:25:38 user nova-compute[75000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1449310249</nova:name>
Nov 06 22:25:38 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:25:38</nova:creationTime>
Nov 06 22:25:38 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:25:38 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:25:38 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:25:38 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:25:38 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:25:38 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:25:38 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:25:38 user nova-compute[75000]:       <nova:owner>
Nov 06 22:25:38 user nova-compute[75000]:         <nova:user uuid="ddbbf039233142eca9f4cdfe2396da7c">tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member</nova:user>
Nov 06 22:25:38 user nova-compute[75000]:         <nova:project uuid="3a7a8c838f784f309fb9f0066e3463ae">tempest-ServerBootFromVolumeStableRescueTest-294256413</nova:project>
Nov 06 22:25:38 user nova-compute[75000]:       </nova:owner>
Nov 06 22:25:38 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:25:38 user nova-compute[75000]:       <nova:ports>
Nov 06 22:25:38 user nova-compute[75000]:         <nova:port uuid="af573ad3-e075-4cd4-83e1-d9fb02479076">
Nov 06 22:25:38 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 22:25:38 user nova-compute[75000]:         </nova:port>
Nov 06 22:25:38 user nova-compute[75000]:       </nova:ports>
Nov 06 22:25:38 user nova-compute[75000]:     </nova:instance>
Nov 06 22:25:38 user nova-compute[75000]:   </metadata>
Nov 06 22:25:38 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:25:38 user nova-compute[75000]:     <system>
Nov 06 22:25:38 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:25:38 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:25:38 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:25:38 user nova-compute[75000]:       <entry name="serial">bf3bafdf-dba5-4961-a891-98f522b27f53</entry>
Nov 06 22:25:38 user nova-compute[75000]:       <entry name="uuid">bf3bafdf-dba5-4961-a891-98f522b27f53</entry>
Nov 06 22:25:38 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:25:38 user nova-compute[75000]:     </system>
Nov 06 22:25:38 user nova-compute[75000]:   </sysinfo>
Nov 06 22:25:38 user nova-compute[75000]:   <os>
Nov 06 22:25:38 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:25:38 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:25:38 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:25:38 user nova-compute[75000]:   </os>
Nov 06 22:25:38 user nova-compute[75000]:   <features>
Nov 06 22:25:38 user nova-compute[75000]:     <acpi/>
Nov 06 22:25:38 user nova-compute[75000]:     <apic/>
Nov 06 22:25:38 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:25:38 user nova-compute[75000]:   </features>
Nov 06 22:25:38 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:25:38 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:25:38 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:25:38 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:25:38 user nova-compute[75000]:   </clock>
Nov 06 22:25:38 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:25:38 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:25:38 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:25:38 user nova-compute[75000]:   </cpu>
Nov 06 22:25:38 user nova-compute[75000]:   <devices>
Nov 06 22:25:38 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:25:38 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:25:38 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk"/>
Nov 06 22:25:38 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:25:38 user nova-compute[75000]:     </disk>
Nov 06 22:25:38 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:25:38 user nova-compute[75000]:       <mac address="fa:16:3e:d3:1e:11"/>
Nov 06 22:25:38 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:38 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:25:38 user nova-compute[75000]:       <target dev="tapaf573ad3-e0"/>
Nov 06 22:25:38 user nova-compute[75000]:     </interface>
Nov 06 22:25:38 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:25:38 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/console.log" append="off"/>
Nov 06 22:25:38 user nova-compute[75000]:     </serial>
Nov 06 22:25:38 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:25:38 user nova-compute[75000]:     <video>
Nov 06 22:25:38 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:38 user nova-compute[75000]:     </video>
Nov 06 22:25:38 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:25:38 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:25:38 user nova-compute[75000]:     </rng>
Nov 06 22:25:38 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:25:38 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:25:38 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:25:38 user nova-compute[75000]:     </memballoon>
Nov 06 22:25:38 user nova-compute[75000]:   </devices>
Nov 06 22:25:38 user nova-compute[75000]: </domain>
Nov 06 22:25:38 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1449310249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1449310249',id=1,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-p0wxclnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:32Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=bf3bafdf-dba5-4961-a891-98f522b27f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:1e:11,bridge_name='br-int',has_traffic_filtering=True,id=af573ad3-e075-4cd4-83e1-d9fb02479076,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf573ad3-e0') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG os_vif [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:1e:11,bridge_name='br-int',has_traffic_filtering=True,id=af573ad3-e075-4cd4-83e1-d9fb02479076,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf573ad3-e0') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Created schema index Interface.name {{(pid=75000) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Created schema index Port.name {{(pid=75000) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Created schema index Bridge.name {{(pid=75000) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [POLLOUT] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.543s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:25:38 user nova-compute[75000]: INFO nova.compute.claims [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Claim successful on node user
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e52e5e3e-c4ea-5ffb-baeb-3aa4c7a881e2', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:25:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:38 user nova-compute[75000]: INFO oslo.privsep.daemon [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp0zeovb3z/privsep.sock']
Nov 06 22:25:38 user sudo[84529]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp0zeovb3z/privsep.sock
Nov 06 22:25:38 user sudo[84529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 22:25:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:25:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Creating image(s)
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.policy [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f50e6a64752e488b9699a8bdda46253c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4b9d5ecee54acb8ca3534a38500b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Updating instance_info_cache with network_info: [{"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Releasing lock "refresh_cache-acb2e909-770b-4cc5-822f-885cca107e1c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Instance network_info: |[{"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-28b57b0a-39b4-4e6f-ab2e-4c26a5e0d8d3 req-5d7996ef-d25f-4234-98c5-85624315356d service nova] Acquired lock "refresh_cache-acb2e909-770b-4cc5-822f-885cca107e1c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.network.neutron [req-28b57b0a-39b4-4e6f-ab2e-4c26a5e0d8d3 req-5d7996ef-d25f-4234-98c5-85624315356d service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Refreshing network info cache for port 97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Start _get_guest_xml network_info=[{"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.224s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:25:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-331902863',display_name='tempest-DeleteServersTestJSON-server-331902863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-331902863',id=2,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4814d9e29ed84398857e2d6d26d8dd7d',ramdisk_id='',reservation_id='r-cbl4yl3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1086801086',owner_user_name='tempest-DeleteServersTestJSON-1086801086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:35Z,user_data=None,user_id='3f0b714b7d304fbaa4b2c4252fbaecbd',uuid=acb2e909-770b-4cc5-822f-885cca107e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Converting VIF {"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:60:7b,bridge_name='br-int',has_traffic_filtering=True,id=97af2be1-4e4d-414a-9233-ff6f508ebded,network=Network(e699e63a-26c2-4755-8a8f-296162917325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97af2be1-4e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lazy-loading 'pci_devices' on Instance uuid acb2e909-770b-4cc5-822f-885cca107e1c {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:25:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:25:39 user nova-compute[75000]:   <uuid>acb2e909-770b-4cc5-822f-885cca107e1c</uuid>
Nov 06 22:25:39 user nova-compute[75000]:   <name>instance-00000002</name>
Nov 06 22:25:39 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:25:39 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:25:39 user nova-compute[75000]:   <metadata>
Nov 06 22:25:39 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:25:39 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:25:39 user nova-compute[75000]:       <nova:name>tempest-DeleteServersTestJSON-server-331902863</nova:name>
Nov 06 22:25:39 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:25:39</nova:creationTime>
Nov 06 22:25:39 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:25:39 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:25:39 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:25:39 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:25:39 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:25:39 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:25:39 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:25:39 user nova-compute[75000]:       <nova:owner>
Nov 06 22:25:39 user nova-compute[75000]:         <nova:user uuid="3f0b714b7d304fbaa4b2c4252fbaecbd">tempest-DeleteServersTestJSON-1086801086-project-member</nova:user>
Nov 06 22:25:39 user nova-compute[75000]:         <nova:project uuid="4814d9e29ed84398857e2d6d26d8dd7d">tempest-DeleteServersTestJSON-1086801086</nova:project>
Nov 06 22:25:39 user nova-compute[75000]:       </nova:owner>
Nov 06 22:25:39 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:25:39 user nova-compute[75000]:       <nova:ports>
Nov 06 22:25:39 user nova-compute[75000]:         <nova:port uuid="97af2be1-4e4d-414a-9233-ff6f508ebded">
Nov 06 22:25:39 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 22:25:39 user nova-compute[75000]:         </nova:port>
Nov 06 22:25:39 user nova-compute[75000]:       </nova:ports>
Nov 06 22:25:39 user nova-compute[75000]:     </nova:instance>
Nov 06 22:25:39 user nova-compute[75000]:   </metadata>
Nov 06 22:25:39 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:25:39 user nova-compute[75000]:     <system>
Nov 06 22:25:39 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:25:39 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:25:39 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:25:39 user nova-compute[75000]:       <entry name="serial">acb2e909-770b-4cc5-822f-885cca107e1c</entry>
Nov 06 22:25:39 user nova-compute[75000]:       <entry name="uuid">acb2e909-770b-4cc5-822f-885cca107e1c</entry>
Nov 06 22:25:39 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:25:39 user nova-compute[75000]:     </system>
Nov 06 22:25:39 user nova-compute[75000]:   </sysinfo>
Nov 06 22:25:39 user nova-compute[75000]:   <os>
Nov 06 22:25:39 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:25:39 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:25:39 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:25:39 user nova-compute[75000]:   </os>
Nov 06 22:25:39 user nova-compute[75000]:   <features>
Nov 06 22:25:39 user nova-compute[75000]:     <acpi/>
Nov 06 22:25:39 user nova-compute[75000]:     <apic/>
Nov 06 22:25:39 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:25:39 user nova-compute[75000]:   </features>
Nov 06 22:25:39 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:25:39 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:25:39 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:25:39 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:25:39 user nova-compute[75000]:   </clock>
Nov 06 22:25:39 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:25:39 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:25:39 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:25:39 user nova-compute[75000]:   </cpu>
Nov 06 22:25:39 user nova-compute[75000]:   <devices>
Nov 06 22:25:39 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:25:39 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:25:39 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk"/>
Nov 06 22:25:39 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:25:39 user nova-compute[75000]:     </disk>
Nov 06 22:25:39 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:25:39 user nova-compute[75000]:       <mac address="fa:16:3e:3b:60:7b"/>
Nov 06 22:25:39 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:39 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:25:39 user nova-compute[75000]:       <target dev="tap97af2be1-4e"/>
Nov 06 22:25:39 user nova-compute[75000]:     </interface>
Nov 06 22:25:39 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:25:39 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/console.log" append="off"/>
Nov 06 22:25:39 user nova-compute[75000]:     </serial>
Nov 06 22:25:39 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:25:39 user nova-compute[75000]:     <video>
Nov 06 22:25:39 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:39 user nova-compute[75000]:     </video>
Nov 06 22:25:39 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:25:39 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:25:39 user nova-compute[75000]:     </rng>
Nov 06 22:25:39 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:25:39 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:25:39 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:25:39 user nova-compute[75000]:     </memballoon>
Nov 06 22:25:39 user nova-compute[75000]:   </devices>
Nov 06 22:25:39 user nova-compute[75000]: </domain>
Nov 06 22:25:39 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-331902863',display_name='tempest-DeleteServersTestJSON-server-331902863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-331902863',id=2,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4814d9e29ed84398857e2d6d26d8dd7d',ramdisk_id='',reservation_id='r-cbl4yl3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1086801086',owner_user_name='tempest-DeleteServersTestJSON-1086801086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:35Z,user_data=None,user_id='3f0b714b7d304fbaa4b2c4252fbaecbd',uuid=acb2e909-770b-4cc5-822f-885cca107e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Converting VIF {"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:60:7b,bridge_name='br-int',has_traffic_filtering=True,id=97af2be1-4e4d-414a-9233-ff6f508ebded,network=Network(e699e63a-26c2-4755-8a8f-296162917325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97af2be1-4e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG os_vif [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:60:7b,bridge_name='br-int',has_traffic_filtering=True,id=97af2be1-4e4d-414a-9233-ff6f508ebded,network=Network(e699e63a-26c2-4755-8a8f-296162917325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97af2be1-4e') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '006072b5-f571-5bad-b7a0-2a1ca5fbcee5', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk 1073741824" returned: 0 in 0.054s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.policy [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6b8ec49509748aab2ab06755faf2a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931a6fc1f8a405f83293c6685dc016e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:25:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Creating image(s)
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "/opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "/opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "/opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:25:39 user nova-compute[75000]: INFO nova.compute.claims [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Claim successful on node user
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.166s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Cannot resize image /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Ensure instance console log exists: /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-426213a6-1a9a-427f-96b3-438dc8aff081 req-17227240-558f-456c-ab3c-9a18322662ec service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updated VIF entry in instance network info cache for port af573ad3-e075-4cd4-83e1-d9fb02479076. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-426213a6-1a9a-427f-96b3-438dc8aff081 req-17227240-558f-456c-ab3c-9a18322662ec service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updating instance_info_cache with network_info: [{"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-426213a6-1a9a-427f-96b3-438dc8aff081 req-17227240-558f-456c-ab3c-9a18322662ec service nova] Releasing lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk 1073741824" returned: 0 in 0.057s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.170s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:25:40 user nova-compute[75000]: INFO nova.compute.claims [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Claim successful on node user
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:25:40 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:25:40 user sudo[84529]: pam_unix(sudo:session): session closed for user root
Nov 06 22:25:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:40 user nova-compute[75000]: INFO oslo.privsep.daemon [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Spawned new privsep daemon via rootwrap
Nov 06 22:25:40 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 22:25:40 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 22:25:40 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 06 22:25:40 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84557
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Cannot resize image /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Ensure instance console log exists: /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:40 user nova-compute[75000]: WARNING oslo_privsep.priv_context [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] privsep daemon already running
Nov 06 22:25:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.policy [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f50e6a64752e488b9699a8bdda46253c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4b9d5ecee54acb8ca3534a38500b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:25:40 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Creating image(s)
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Successfully created port: f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:25:41 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.policy [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8b116c4cb154ce0a1a80045258cd123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54eb33cd621c4fa78fead18be74916ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.250s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf573ad3-e0, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf573ad3-e0, col_values=(('qos', UUID('9e1648d5-c555-47f4-9593-c7cf469d5a3b')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf573ad3-e0, col_values=(('external_ids', {'iface-id': 'af573ad3-e075-4cd4-83e1-d9fb02479076', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:1e:11', 'vm-uuid': 'bf3bafdf-dba5-4961-a891-98f522b27f53'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk 1073741824" returned: 0 in 0.067s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-28b57b0a-39b4-4e6f-ab2e-4c26a5e0d8d3 req-5d7996ef-d25f-4234-98c5-85624315356d service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Updated VIF entry in instance network info cache for port 97af2be1-4e4d-414a-9233-ff6f508ebded. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-28b57b0a-39b4-4e6f-ab2e-4c26a5e0d8d3 req-5d7996ef-d25f-4234-98c5-85624315356d service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Updating instance_info_cache with network_info: [{"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:41 user nova-compute[75000]: INFO os_vif [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:1e:11,bridge_name='br-int',has_traffic_filtering=True,id=af573ad3-e075-4cd4-83e1-d9fb02479076,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf573ad3-e0')
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97af2be1-4e, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97af2be1-4e, col_values=(('qos', UUID('ae51228d-d7cd-47c4-be94-9cd3f826562a')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97af2be1-4e, col_values=(('external_ids', {'iface-id': '97af2be1-4e4d-414a-9233-ff6f508ebded', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:60:7b', 'vm-uuid': 'acb2e909-770b-4cc5-822f-885cca107e1c'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:25:41 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Creating image(s)
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "/opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "/opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "/opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-28b57b0a-39b4-4e6f-ab2e-4c26a5e0d8d3 req-5d7996ef-d25f-4234-98c5-85624315356d service nova] Releasing lock "refresh_cache-acb2e909-770b-4cc5-822f-885cca107e1c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:41 user nova-compute[75000]: INFO os_vif [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:60:7b,bridge_name='br-int',has_traffic_filtering=True,id=97af2be1-4e4d-414a-9233-ff6f508ebded,network=Network(e699e63a-26c2-4755-8a8f-296162917325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97af2be1-4e')
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No VIF found with MAC fa:16:3e:d3:1e:11, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] No VIF found with MAC fa:16:3e:3b:60:7b, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.258s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Cannot resize image /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Ensure instance console log exists: /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.249s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Successfully created port: 7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk 1073741824" returned: 0 in 0.071s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Successfully created port: 031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Cannot resize image /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Ensure instance console log exists: /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.neutron [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Successfully updated port: f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquired lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.neutron [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Successfully created port: f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.neutron [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.compute.manager [req-8965593e-7471-4b5d-9d1e-4e7b7ab4f767 req-c1869d90-eaf3-4bf1-8b8a-d498d8f544a2 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-changed-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.compute.manager [req-8965593e-7471-4b5d-9d1e-4e7b7ab4f767 req-c1869d90-eaf3-4bf1-8b8a-d498d8f544a2 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Refreshing instance network info cache due to event network-changed-f671c9ae-e9f9-4276-8291-76aaf4510fa8. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8965593e-7471-4b5d-9d1e-4e7b7ab4f767 req-c1869d90-eaf3-4bf1-8b8a-d498d8f544a2 service nova] Acquiring lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.neutron [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updating instance_info_cache with network_info: [{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Releasing lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Instance network_info: |[{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8965593e-7471-4b5d-9d1e-4e7b7ab4f767 req-c1869d90-eaf3-4bf1-8b8a-d498d8f544a2 service nova] Acquired lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.neutron [req-8965593e-7471-4b5d-9d1e-4e7b7ab4f767 req-c1869d90-eaf3-4bf1-8b8a-d498d8f544a2 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Refreshing network info cache for port f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Start _get_guest_xml network_info=[{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:25:43 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:43 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1791801885',display_name='tempest-ServerRescueNegativeTestJSON-server-1791801885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1791801885',id=4,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-3wtyelfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:39Z,user_data=None,user_id='f50e6a64752e488b9699a8bdda46253c',uuid=f48bca3c-8e15-4729-a01c-9741c4794a2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=f671c9ae-e9f9-4276-8291-76aaf4510fa8,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf671c9ae-e9') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.objects.instance [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'pci_devices' on Instance uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:25:43 user nova-compute[75000]:   <uuid>f48bca3c-8e15-4729-a01c-9741c4794a2f</uuid>
Nov 06 22:25:43 user nova-compute[75000]:   <name>instance-00000004</name>
Nov 06 22:25:43 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:25:43 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:25:43 user nova-compute[75000]:   <metadata>
Nov 06 22:25:43 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:25:43 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:25:43 user nova-compute[75000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1791801885</nova:name>
Nov 06 22:25:43 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:25:43</nova:creationTime>
Nov 06 22:25:43 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:25:43 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:25:43 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:25:43 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:25:43 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:25:43 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:25:43 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:25:43 user nova-compute[75000]:       <nova:owner>
Nov 06 22:25:43 user nova-compute[75000]:         <nova:user uuid="f50e6a64752e488b9699a8bdda46253c">tempest-ServerRescueNegativeTestJSON-259573853-project-member</nova:user>
Nov 06 22:25:43 user nova-compute[75000]:         <nova:project uuid="5b4b9d5ecee54acb8ca3534a38500b4f">tempest-ServerRescueNegativeTestJSON-259573853</nova:project>
Nov 06 22:25:43 user nova-compute[75000]:       </nova:owner>
Nov 06 22:25:43 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:25:43 user nova-compute[75000]:       <nova:ports>
Nov 06 22:25:43 user nova-compute[75000]:         <nova:port uuid="f671c9ae-e9f9-4276-8291-76aaf4510fa8">
Nov 06 22:25:43 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:25:43 user nova-compute[75000]:         </nova:port>
Nov 06 22:25:43 user nova-compute[75000]:       </nova:ports>
Nov 06 22:25:43 user nova-compute[75000]:     </nova:instance>
Nov 06 22:25:43 user nova-compute[75000]:   </metadata>
Nov 06 22:25:43 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:25:43 user nova-compute[75000]:     <system>
Nov 06 22:25:43 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:25:43 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:25:43 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:25:43 user nova-compute[75000]:       <entry name="serial">f48bca3c-8e15-4729-a01c-9741c4794a2f</entry>
Nov 06 22:25:43 user nova-compute[75000]:       <entry name="uuid">f48bca3c-8e15-4729-a01c-9741c4794a2f</entry>
Nov 06 22:25:43 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:25:43 user nova-compute[75000]:     </system>
Nov 06 22:25:43 user nova-compute[75000]:   </sysinfo>
Nov 06 22:25:43 user nova-compute[75000]:   <os>
Nov 06 22:25:43 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:25:43 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:25:43 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:25:43 user nova-compute[75000]:   </os>
Nov 06 22:25:43 user nova-compute[75000]:   <features>
Nov 06 22:25:43 user nova-compute[75000]:     <acpi/>
Nov 06 22:25:43 user nova-compute[75000]:     <apic/>
Nov 06 22:25:43 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:25:43 user nova-compute[75000]:   </features>
Nov 06 22:25:43 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:25:43 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:25:43 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:25:43 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:25:43 user nova-compute[75000]:   </clock>
Nov 06 22:25:43 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:25:43 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:25:43 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:25:43 user nova-compute[75000]:   </cpu>
Nov 06 22:25:43 user nova-compute[75000]:   <devices>
Nov 06 22:25:43 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:25:43 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:25:43 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk"/>
Nov 06 22:25:43 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:25:43 user nova-compute[75000]:     </disk>
Nov 06 22:25:43 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:25:43 user nova-compute[75000]:       <mac address="fa:16:3e:e4:ec:d9"/>
Nov 06 22:25:43 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:43 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:25:43 user nova-compute[75000]:       <target dev="tapf671c9ae-e9"/>
Nov 06 22:25:43 user nova-compute[75000]:     </interface>
Nov 06 22:25:43 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:25:43 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/console.log" append="off"/>
Nov 06 22:25:43 user nova-compute[75000]:     </serial>
Nov 06 22:25:43 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:25:43 user nova-compute[75000]:     <video>
Nov 06 22:25:43 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:43 user nova-compute[75000]:     </video>
Nov 06 22:25:43 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:25:43 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:25:43 user nova-compute[75000]:     </rng>
Nov 06 22:25:43 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:25:43 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:25:43 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:25:43 user nova-compute[75000]:     </memballoon>
Nov 06 22:25:43 user nova-compute[75000]:   </devices>
Nov 06 22:25:43 user nova-compute[75000]: </domain>
Nov 06 22:25:43 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1791801885',display_name='tempest-ServerRescueNegativeTestJSON-server-1791801885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1791801885',id=4,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-3wtyelfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:39Z,user_data=None,user_id='f50e6a64752e488b9699a8bdda46253c',uuid=f48bca3c-8e15-4729-a01c-9741c4794a2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=f671c9ae-e9f9-4276-8291-76aaf4510fa8,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf671c9ae-e9') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG os_vif [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=f671c9ae-e9f9-4276-8291-76aaf4510fa8,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf671c9ae-e9') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab79ffab-473b-5eea-a954-96bb2d17084c', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf671c9ae-e9, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf671c9ae-e9, col_values=(('qos', UUID('cf64f136-a7aa-47e0-aec3-9fec6cc6d13a')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf671c9ae-e9, col_values=(('external_ids', {'iface-id': 'f671c9ae-e9f9-4276-8291-76aaf4510fa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:ec:d9', 'vm-uuid': 'f48bca3c-8e15-4729-a01c-9741c4794a2f'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: INFO os_vif [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=f671c9ae-e9f9-4276-8291-76aaf4510fa8,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf671c9ae-e9')
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No VIF found with MAC fa:16:3e:e4:ec:d9, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Successfully updated port: 7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquired lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-8965593e-7471-4b5d-9d1e-4e7b7ab4f767 req-c1869d90-eaf3-4bf1-8b8a-d498d8f544a2 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updated VIF entry in instance network info cache for port f671c9ae-e9f9-4276-8291-76aaf4510fa8. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-8965593e-7471-4b5d-9d1e-4e7b7ab4f767 req-c1869d90-eaf3-4bf1-8b8a-d498d8f544a2 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updating instance_info_cache with network_info: [{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-679cbb01-a071-44ca-b3e2-62b68dce1afd req-5a9c37ee-73e0-4c5f-b567-fcbf3e01e77b service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received event network-changed-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-679cbb01-a071-44ca-b3e2-62b68dce1afd req-5a9c37ee-73e0-4c5f-b567-fcbf3e01e77b service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Refreshing instance network info cache due to event network-changed-7a108ec5-3780-43e6-a8da-e1a44ecffd8e. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-679cbb01-a071-44ca-b3e2-62b68dce1afd req-5a9c37ee-73e0-4c5f-b567-fcbf3e01e77b service nova] Acquiring lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8965593e-7471-4b5d-9d1e-4e7b7ab4f767 req-c1869d90-eaf3-4bf1-8b8a-d498d8f544a2 service nova] Releasing lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Successfully updated port: 031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquired lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-5589f7d3-f2e4-49ee-92da-6ab67bdf504e req-9a13216e-920d-41df-a912-f5edaefb7935 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received event network-changed-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-5589f7d3-f2e4-49ee-92da-6ab67bdf504e req-9a13216e-920d-41df-a912-f5edaefb7935 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Refreshing instance network info cache due to event network-changed-031b54fe-fcfa-4d89-92fc-83adb16b5458. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5589f7d3-f2e4-49ee-92da-6ab67bdf504e req-9a13216e-920d-41df-a912-f5edaefb7935 service nova] Acquiring lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:44 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updating instance_info_cache with network_info: [{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Releasing lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Instance network_info: |[{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-679cbb01-a071-44ca-b3e2-62b68dce1afd req-5a9c37ee-73e0-4c5f-b567-fcbf3e01e77b service nova] Acquired lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.network.neutron [req-679cbb01-a071-44ca-b3e2-62b68dce1afd req-5a9c37ee-73e0-4c5f-b567-fcbf3e01e77b service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Refreshing network info cache for port 7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Start _get_guest_xml network_info=[{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:25:45 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:45 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-217377317',display_name='tempest-ServerActionsTestOtherA-server-217377317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-217377317',id=3,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWWSt8DqD1UiX7y0P2zcc1XaSgfLqWPMHCsT4qhuCpJN/KYahOdMyvjBaIfA8wTAtF3OG7T0GjKSjZNjN+adINTC3kMpTN5nU53yfK9kl9yrZK3oIAKJYF1R8Z+Truelg==',key_name='tempest-keypair-832438895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-4oc6tofp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=97e834ec-a286-4da9-a6b8-164a1061f042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:2c:98,bridge_name='br-int',has_traffic_filtering=True,id=7a108ec5-3780-43e6-a8da-e1a44ecffd8e,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a108ec5-37') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'pci_devices' on Instance uuid 97e834ec-a286-4da9-a6b8-164a1061f042 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:25:45 user nova-compute[75000]:   <uuid>97e834ec-a286-4da9-a6b8-164a1061f042</uuid>
Nov 06 22:25:45 user nova-compute[75000]:   <name>instance-00000003</name>
Nov 06 22:25:45 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:25:45 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:25:45 user nova-compute[75000]:   <metadata>
Nov 06 22:25:45 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:25:45 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:25:45 user nova-compute[75000]:       <nova:name>tempest-ServerActionsTestOtherA-server-217377317</nova:name>
Nov 06 22:25:45 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:25:45</nova:creationTime>
Nov 06 22:25:45 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:25:45 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:25:45 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:25:45 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:25:45 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:25:45 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:25:45 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:25:45 user nova-compute[75000]:       <nova:owner>
Nov 06 22:25:45 user nova-compute[75000]:         <nova:user uuid="c6b8ec49509748aab2ab06755faf2a2d">tempest-ServerActionsTestOtherA-287714099-project-member</nova:user>
Nov 06 22:25:45 user nova-compute[75000]:         <nova:project uuid="c931a6fc1f8a405f83293c6685dc016e">tempest-ServerActionsTestOtherA-287714099</nova:project>
Nov 06 22:25:45 user nova-compute[75000]:       </nova:owner>
Nov 06 22:25:45 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:25:45 user nova-compute[75000]:       <nova:ports>
Nov 06 22:25:45 user nova-compute[75000]:         <nova:port uuid="7a108ec5-3780-43e6-a8da-e1a44ecffd8e">
Nov 06 22:25:45 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 22:25:45 user nova-compute[75000]:         </nova:port>
Nov 06 22:25:45 user nova-compute[75000]:       </nova:ports>
Nov 06 22:25:45 user nova-compute[75000]:     </nova:instance>
Nov 06 22:25:45 user nova-compute[75000]:   </metadata>
Nov 06 22:25:45 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:25:45 user nova-compute[75000]:     <system>
Nov 06 22:25:45 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:25:45 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:25:45 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:25:45 user nova-compute[75000]:       <entry name="serial">97e834ec-a286-4da9-a6b8-164a1061f042</entry>
Nov 06 22:25:45 user nova-compute[75000]:       <entry name="uuid">97e834ec-a286-4da9-a6b8-164a1061f042</entry>
Nov 06 22:25:45 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:25:45 user nova-compute[75000]:     </system>
Nov 06 22:25:45 user nova-compute[75000]:   </sysinfo>
Nov 06 22:25:45 user nova-compute[75000]:   <os>
Nov 06 22:25:45 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:25:45 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:25:45 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:25:45 user nova-compute[75000]:   </os>
Nov 06 22:25:45 user nova-compute[75000]:   <features>
Nov 06 22:25:45 user nova-compute[75000]:     <acpi/>
Nov 06 22:25:45 user nova-compute[75000]:     <apic/>
Nov 06 22:25:45 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:25:45 user nova-compute[75000]:   </features>
Nov 06 22:25:45 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:25:45 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:25:45 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:25:45 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:25:45 user nova-compute[75000]:   </clock>
Nov 06 22:25:45 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:25:45 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:25:45 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:25:45 user nova-compute[75000]:   </cpu>
Nov 06 22:25:45 user nova-compute[75000]:   <devices>
Nov 06 22:25:45 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:25:45 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:25:45 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk"/>
Nov 06 22:25:45 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:25:45 user nova-compute[75000]:     </disk>
Nov 06 22:25:45 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:25:45 user nova-compute[75000]:       <mac address="fa:16:3e:27:2c:98"/>
Nov 06 22:25:45 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:45 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:25:45 user nova-compute[75000]:       <target dev="tap7a108ec5-37"/>
Nov 06 22:25:45 user nova-compute[75000]:     </interface>
Nov 06 22:25:45 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:25:45 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/console.log" append="off"/>
Nov 06 22:25:45 user nova-compute[75000]:     </serial>
Nov 06 22:25:45 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:25:45 user nova-compute[75000]:     <video>
Nov 06 22:25:45 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:45 user nova-compute[75000]:     </video>
Nov 06 22:25:45 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:25:45 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:25:45 user nova-compute[75000]:     </rng>
Nov 06 22:25:45 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:25:45 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:25:45 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:25:45 user nova-compute[75000]:     </memballoon>
Nov 06 22:25:45 user nova-compute[75000]:   </devices>
Nov 06 22:25:45 user nova-compute[75000]: </domain>
Nov 06 22:25:45 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-217377317',display_name='tempest-ServerActionsTestOtherA-server-217377317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-217377317',id=3,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWWSt8DqD1UiX7y0P2zcc1XaSgfLqWPMHCsT4qhuCpJN/KYahOdMyvjBaIfA8wTAtF3OG7T0GjKSjZNjN+adINTC3kMpTN5nU53yfK9kl9yrZK3oIAKJYF1R8Z+Truelg==',key_name='tempest-keypair-832438895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-4oc6tofp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=97e834ec-a286-4da9-a6b8-164a1061f042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:2c:98,bridge_name='br-int',has_traffic_filtering=True,id=7a108ec5-3780-43e6-a8da-e1a44ecffd8e,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a108ec5-37') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG os_vif [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:2c:98,bridge_name='br-int',has_traffic_filtering=True,id=7a108ec5-3780-43e6-a8da-e1a44ecffd8e,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a108ec5-37') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '823be021-6db7-5e4d-9dd0-0f9be54730f5', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a108ec5-37, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a108ec5-37, col_values=(('qos', UUID('9be09d3f-07c3-4ffe-ad93-38720ee0e721')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a108ec5-37, col_values=(('external_ids', {'iface-id': '7a108ec5-3780-43e6-a8da-e1a44ecffd8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:2c:98', 'vm-uuid': '97e834ec-a286-4da9-a6b8-164a1061f042'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:45 user nova-compute[75000]: INFO os_vif [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:2c:98,bridge_name='br-int',has_traffic_filtering=True,id=7a108ec5-3780-43e6-a8da-e1a44ecffd8e,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a108ec5-37')
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:25:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No VIF found with MAC fa:16:3e:27:2c:98, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.network.neutron [req-679cbb01-a071-44ca-b3e2-62b68dce1afd req-5a9c37ee-73e0-4c5f-b567-fcbf3e01e77b service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updated VIF entry in instance network info cache for port 7a108ec5-3780-43e6-a8da-e1a44ecffd8e. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.network.neutron [req-679cbb01-a071-44ca-b3e2-62b68dce1afd req-5a9c37ee-73e0-4c5f-b567-fcbf3e01e77b service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updating instance_info_cache with network_info: [{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-679cbb01-a071-44ca-b3e2-62b68dce1afd req-5a9c37ee-73e0-4c5f-b567-fcbf3e01e77b service nova] Releasing lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updating instance_info_cache with network_info: [{"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Releasing lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Instance network_info: |[{"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5589f7d3-f2e4-49ee-92da-6ab67bdf504e req-9a13216e-920d-41df-a912-f5edaefb7935 service nova] Acquired lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.network.neutron [req-5589f7d3-f2e4-49ee-92da-6ab67bdf504e req-9a13216e-920d-41df-a912-f5edaefb7935 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Refreshing network info cache for port 031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Start _get_guest_xml network_info=[{"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:25:46 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:46 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-627868483',display_name='tempest-ServerRescueNegativeTestJSON-server-627868483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-627868483',id=5,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-5y4ic5jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:41Z,user_data=None,user_id='f50e6a64752e488b9699a8bdda46253c',uuid=b2c6375a-d847-45e8-a0e8-42b37eb0af7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=031b54fe-fcfa-4d89-92fc-83adb16b5458,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031b54fe-fc') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:25:46 user nova-compute[75000]:   <uuid>b2c6375a-d847-45e8-a0e8-42b37eb0af7f</uuid>
Nov 06 22:25:46 user nova-compute[75000]:   <name>instance-00000005</name>
Nov 06 22:25:46 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:25:46 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:25:46 user nova-compute[75000]:   <metadata>
Nov 06 22:25:46 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:25:46 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:25:46 user nova-compute[75000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-627868483</nova:name>
Nov 06 22:25:46 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:25:46</nova:creationTime>
Nov 06 22:25:46 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:25:46 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:25:46 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:25:46 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:25:46 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:25:46 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:25:46 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:25:46 user nova-compute[75000]:       <nova:owner>
Nov 06 22:25:46 user nova-compute[75000]:         <nova:user uuid="f50e6a64752e488b9699a8bdda46253c">tempest-ServerRescueNegativeTestJSON-259573853-project-member</nova:user>
Nov 06 22:25:46 user nova-compute[75000]:         <nova:project uuid="5b4b9d5ecee54acb8ca3534a38500b4f">tempest-ServerRescueNegativeTestJSON-259573853</nova:project>
Nov 06 22:25:46 user nova-compute[75000]:       </nova:owner>
Nov 06 22:25:46 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:25:46 user nova-compute[75000]:       <nova:ports>
Nov 06 22:25:46 user nova-compute[75000]:         <nova:port uuid="031b54fe-fcfa-4d89-92fc-83adb16b5458">
Nov 06 22:25:46 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 22:25:46 user nova-compute[75000]:         </nova:port>
Nov 06 22:25:46 user nova-compute[75000]:       </nova:ports>
Nov 06 22:25:46 user nova-compute[75000]:     </nova:instance>
Nov 06 22:25:46 user nova-compute[75000]:   </metadata>
Nov 06 22:25:46 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:25:46 user nova-compute[75000]:     <system>
Nov 06 22:25:46 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:25:46 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:25:46 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:25:46 user nova-compute[75000]:       <entry name="serial">b2c6375a-d847-45e8-a0e8-42b37eb0af7f</entry>
Nov 06 22:25:46 user nova-compute[75000]:       <entry name="uuid">b2c6375a-d847-45e8-a0e8-42b37eb0af7f</entry>
Nov 06 22:25:46 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:25:46 user nova-compute[75000]:     </system>
Nov 06 22:25:46 user nova-compute[75000]:   </sysinfo>
Nov 06 22:25:46 user nova-compute[75000]:   <os>
Nov 06 22:25:46 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:25:46 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:25:46 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:25:46 user nova-compute[75000]:   </os>
Nov 06 22:25:46 user nova-compute[75000]:   <features>
Nov 06 22:25:46 user nova-compute[75000]:     <acpi/>
Nov 06 22:25:46 user nova-compute[75000]:     <apic/>
Nov 06 22:25:46 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:25:46 user nova-compute[75000]:   </features>
Nov 06 22:25:46 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:25:46 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:25:46 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:25:46 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:25:46 user nova-compute[75000]:   </clock>
Nov 06 22:25:46 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:25:46 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:25:46 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:25:46 user nova-compute[75000]:   </cpu>
Nov 06 22:25:46 user nova-compute[75000]:   <devices>
Nov 06 22:25:46 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:25:46 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:25:46 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk"/>
Nov 06 22:25:46 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:25:46 user nova-compute[75000]:     </disk>
Nov 06 22:25:46 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:25:46 user nova-compute[75000]:       <mac address="fa:16:3e:54:00:b6"/>
Nov 06 22:25:46 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:46 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:25:46 user nova-compute[75000]:       <target dev="tap031b54fe-fc"/>
Nov 06 22:25:46 user nova-compute[75000]:     </interface>
Nov 06 22:25:46 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:25:46 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/console.log" append="off"/>
Nov 06 22:25:46 user nova-compute[75000]:     </serial>
Nov 06 22:25:46 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:25:46 user nova-compute[75000]:     <video>
Nov 06 22:25:46 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:46 user nova-compute[75000]:     </video>
Nov 06 22:25:46 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:25:46 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:25:46 user nova-compute[75000]:     </rng>
Nov 06 22:25:46 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:25:46 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:25:46 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:25:46 user nova-compute[75000]:     </memballoon>
Nov 06 22:25:46 user nova-compute[75000]:   </devices>
Nov 06 22:25:46 user nova-compute[75000]: </domain>
Nov 06 22:25:46 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-627868483',display_name='tempest-ServerRescueNegativeTestJSON-server-627868483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-627868483',id=5,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-5y4ic5jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:41Z,user_data=None,user_id='f50e6a64752e488b9699a8bdda46253c',uuid=b2c6375a-d847-45e8-a0e8-42b37eb0af7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=031b54fe-fcfa-4d89-92fc-83adb16b5458,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031b54fe-fc') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG os_vif [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=031b54fe-fcfa-4d89-92fc-83adb16b5458,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031b54fe-fc') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78c670e9-7bad-55af-9031-2c8448f36922', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap031b54fe-fc, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap031b54fe-fc, col_values=(('qos', UUID('f9150373-e3ef-48d6-9c1b-780cf6235a9d')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap031b54fe-fc, col_values=(('external_ids', {'iface-id': '031b54fe-fcfa-4d89-92fc-83adb16b5458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:00:b6', 'vm-uuid': 'b2c6375a-d847-45e8-a0e8-42b37eb0af7f'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:46 user nova-compute[75000]: INFO os_vif [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=031b54fe-fcfa-4d89-92fc-83adb16b5458,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031b54fe-fc')
Nov 06 22:25:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No VIF found with MAC fa:16:3e:54:00:b6, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Successfully updated port: f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquired lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-057cf156-f2d9-4a4d-adc6-8347b421f3e6 req-2b09ea51-7259-45b4-a330-2c305349bf09 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-changed-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-057cf156-f2d9-4a4d-adc6-8347b421f3e6 req-2b09ea51-7259-45b4-a330-2c305349bf09 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Refreshing instance network info cache due to event network-changed-f6cb1907-7cf4-46fd-9526-9c885c806ce2. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-057cf156-f2d9-4a4d-adc6-8347b421f3e6 req-2b09ea51-7259-45b4-a330-2c305349bf09 service nova] Acquiring lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:25:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Instance spawned successfully.
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.network.neutron [req-5589f7d3-f2e4-49ee-92da-6ab67bdf504e req-9a13216e-920d-41df-a912-f5edaefb7935 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updated VIF entry in instance network info cache for port 031b54fe-fcfa-4d89-92fc-83adb16b5458. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.network.neutron [req-5589f7d3-f2e4-49ee-92da-6ab67bdf504e req-9a13216e-920d-41df-a912-f5edaefb7935 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updating instance_info_cache with network_info: [{"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5589f7d3-f2e4-49ee-92da-6ab67bdf504e req-9a13216e-920d-41df-a912-f5edaefb7935 service nova] Releasing lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance_info_cache with network_info: [{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:48 user nova-compute[75000]: INFO nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Took 16.55 seconds to spawn the instance on the hypervisor.
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Releasing lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance network_info: |[{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-057cf156-f2d9-4a4d-adc6-8347b421f3e6 req-2b09ea51-7259-45b4-a330-2c305349bf09 service nova] Acquired lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.network.neutron [req-057cf156-f2d9-4a4d-adc6-8347b421f3e6 req-2b09ea51-7259-45b4-a330-2c305349bf09 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Refreshing network info cache for port f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Start _get_guest_xml network_info=[{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:25:48 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:48 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-410044661',display_name='tempest-ServerActionsTestOtherB-server-410044661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-410044661',id=6,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN127j9rMCzJhcsyMMnA9oMyDSW626YDveQjSPb2IR7mcffJ8blZhWvgtIPRXJ9KDmmNRktgeSU8SDicFRInDOK2YoxINbUZ+i2iHac2q1b7ra/rMkxI3W72lm49ZRgf7w==',key_name='tempest-keypair-1677332467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb33cd621c4fa78fead18be74916ee',ramdisk_id='',reservation_id='r-nlmmujhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-408033839',owner_user_name='tempest-ServerActionsTestOtherB-408033839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8b116c4cb154ce0a1a80045258cd123',uuid=846bf5e2-230c-419c-be77-982acc036b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converting VIF {"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.objects.instance [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lazy-loading 'pci_devices' on Instance uuid 846bf5e2-230c-419c-be77-982acc036b40 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:25:48 user nova-compute[75000]:   <uuid>846bf5e2-230c-419c-be77-982acc036b40</uuid>
Nov 06 22:25:48 user nova-compute[75000]:   <name>instance-00000006</name>
Nov 06 22:25:48 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:25:48 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:25:48 user nova-compute[75000]:   <metadata>
Nov 06 22:25:48 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:25:48 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:25:48 user nova-compute[75000]:       <nova:name>tempest-ServerActionsTestOtherB-server-410044661</nova:name>
Nov 06 22:25:48 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:25:48</nova:creationTime>
Nov 06 22:25:48 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:25:48 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:25:48 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:25:48 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:25:48 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:25:48 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:25:48 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:25:48 user nova-compute[75000]:       <nova:owner>
Nov 06 22:25:48 user nova-compute[75000]:         <nova:user uuid="c8b116c4cb154ce0a1a80045258cd123">tempest-ServerActionsTestOtherB-408033839-project-member</nova:user>
Nov 06 22:25:48 user nova-compute[75000]:         <nova:project uuid="54eb33cd621c4fa78fead18be74916ee">tempest-ServerActionsTestOtherB-408033839</nova:project>
Nov 06 22:25:48 user nova-compute[75000]:       </nova:owner>
Nov 06 22:25:48 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:25:48 user nova-compute[75000]:       <nova:ports>
Nov 06 22:25:48 user nova-compute[75000]:         <nova:port uuid="f6cb1907-7cf4-46fd-9526-9c885c806ce2">
Nov 06 22:25:48 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 22:25:48 user nova-compute[75000]:         </nova:port>
Nov 06 22:25:48 user nova-compute[75000]:       </nova:ports>
Nov 06 22:25:48 user nova-compute[75000]:     </nova:instance>
Nov 06 22:25:48 user nova-compute[75000]:   </metadata>
Nov 06 22:25:48 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:25:48 user nova-compute[75000]:     <system>
Nov 06 22:25:48 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:25:48 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:25:48 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:25:48 user nova-compute[75000]:       <entry name="serial">846bf5e2-230c-419c-be77-982acc036b40</entry>
Nov 06 22:25:48 user nova-compute[75000]:       <entry name="uuid">846bf5e2-230c-419c-be77-982acc036b40</entry>
Nov 06 22:25:48 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:25:48 user nova-compute[75000]:     </system>
Nov 06 22:25:48 user nova-compute[75000]:   </sysinfo>
Nov 06 22:25:48 user nova-compute[75000]:   <os>
Nov 06 22:25:48 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:25:48 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:25:48 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:25:48 user nova-compute[75000]:   </os>
Nov 06 22:25:48 user nova-compute[75000]:   <features>
Nov 06 22:25:48 user nova-compute[75000]:     <acpi/>
Nov 06 22:25:48 user nova-compute[75000]:     <apic/>
Nov 06 22:25:48 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:25:48 user nova-compute[75000]:   </features>
Nov 06 22:25:48 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:25:48 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:25:48 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:25:48 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:25:48 user nova-compute[75000]:   </clock>
Nov 06 22:25:48 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:25:48 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:25:48 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:25:48 user nova-compute[75000]:   </cpu>
Nov 06 22:25:48 user nova-compute[75000]:   <devices>
Nov 06 22:25:48 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:25:48 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:25:48 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk"/>
Nov 06 22:25:48 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:25:48 user nova-compute[75000]:     </disk>
Nov 06 22:25:48 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:25:48 user nova-compute[75000]:       <mac address="fa:16:3e:4f:6d:94"/>
Nov 06 22:25:48 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:48 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:25:48 user nova-compute[75000]:       <target dev="tapf6cb1907-7c"/>
Nov 06 22:25:48 user nova-compute[75000]:     </interface>
Nov 06 22:25:48 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:25:48 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/console.log" append="off"/>
Nov 06 22:25:48 user nova-compute[75000]:     </serial>
Nov 06 22:25:48 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:25:48 user nova-compute[75000]:     <video>
Nov 06 22:25:48 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:25:48 user nova-compute[75000]:     </video>
Nov 06 22:25:48 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:25:48 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:25:48 user nova-compute[75000]:     </rng>
Nov 06 22:25:48 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:25:48 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:25:48 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:25:48 user nova-compute[75000]:     </memballoon>
Nov 06 22:25:48 user nova-compute[75000]:   </devices>
Nov 06 22:25:48 user nova-compute[75000]: </domain>
Nov 06 22:25:48 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-410044661',display_name='tempest-ServerActionsTestOtherB-server-410044661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-410044661',id=6,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN127j9rMCzJhcsyMMnA9oMyDSW626YDveQjSPb2IR7mcffJ8blZhWvgtIPRXJ9KDmmNRktgeSU8SDicFRInDOK2YoxINbUZ+i2iHac2q1b7ra/rMkxI3W72lm49ZRgf7w==',key_name='tempest-keypair-1677332467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54eb33cd621c4fa78fead18be74916ee',ramdisk_id='',reservation_id='r-nlmmujhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-408033839',owner_user_name='tempest-ServerActionsTestOtherB-408033839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8b116c4cb154ce0a1a80045258cd123',uuid=846bf5e2-230c-419c-be77-982acc036b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converting VIF {"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG os_vif [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fc03e8f-ec08-5990-a9eb-0217578c15b2', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: INFO nova.compute.manager [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Took 17.63 seconds to build instance.
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6cb1907-7c, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6cb1907-7c, col_values=(('qos', UUID('11a6958f-8541-4503-96f7-88282d8a3ecf')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6cb1907-7c, col_values=(('external_ids', {'iface-id': 'f6cb1907-7cf4-46fd-9526-9c885c806ce2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:6d:94', 'vm-uuid': '846bf5e2-230c-419c-be77-982acc036b40'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b8d258ff-14af-4e8d-89d0-877d9f0dfeda tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.891s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:48 user nova-compute[75000]: INFO os_vif [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c')
Nov 06 22:25:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:25:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] No VIF found with MAC fa:16:3e:4f:6d:94, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:25:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:50 user nova-compute[75000]: DEBUG nova.network.neutron [req-057cf156-f2d9-4a4d-adc6-8347b421f3e6 req-2b09ea51-7259-45b4-a330-2c305349bf09 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updated VIF entry in instance network info cache for port f6cb1907-7cf4-46fd-9526-9c885c806ce2. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:25:50 user nova-compute[75000]: DEBUG nova.network.neutron [req-057cf156-f2d9-4a4d-adc6-8347b421f3e6 req-2b09ea51-7259-45b4-a330-2c305349bf09 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance_info_cache with network_info: [{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:25:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-057cf156-f2d9-4a4d-adc6-8347b421f3e6 req-2b09ea51-7259-45b4-a330-2c305349bf09 service nova] Releasing lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:25:51 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Instance spawned successfully.
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:51 user nova-compute[75000]: INFO nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Took 16.56 seconds to spawn the instance on the hypervisor.
Nov 06 22:25:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:25:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:51 user nova-compute[75000]: INFO nova.compute.manager [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Took 17.48 seconds to build instance.
Nov 06 22:25:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8451f12-892e-446c-bf69-218e58848def tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.663s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-3c75562b-cd16-4846-bfd2-f3a3cd43f204 req-04da04dc-b14b-4782-ac37-bc574329c5f0 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3c75562b-cd16-4846-bfd2-f3a3cd43f204 req-04da04dc-b14b-4782-ac37-bc574329c5f0 service nova] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3c75562b-cd16-4846-bfd2-f3a3cd43f204 req-04da04dc-b14b-4782-ac37-bc574329c5f0 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3c75562b-cd16-4846-bfd2-f3a3cd43f204 req-04da04dc-b14b-4782-ac37-bc574329c5f0 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-3c75562b-cd16-4846-bfd2-f3a3cd43f204 req-04da04dc-b14b-4782-ac37-bc574329c5f0 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] No waiting events found dispatching network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:25:54 user nova-compute[75000]: WARNING nova.compute.manager [req-3c75562b-cd16-4846-bfd2-f3a3cd43f204 req-04da04dc-b14b-4782-ac37-bc574329c5f0 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received unexpected event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 for instance with vm_state active and task_state None.
Nov 06 22:25:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:25:55 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Instance spawned successfully.
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:25:55 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Instance spawned successfully.
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:55 user nova-compute[75000]: INFO nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Took 16.81 seconds to spawn the instance on the hypervisor.
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:25:55 user nova-compute[75000]: INFO nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Took 16.20 seconds to spawn the instance on the hypervisor.
Nov 06 22:25:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:25:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Instance spawned successfully.
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:25:56 user nova-compute[75000]: INFO nova.compute.manager [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Took 18.04 seconds to build instance.
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-674cecaf-d756-4319-b221-d48996078445 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.226s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:25:56 user nova-compute[75000]: INFO nova.compute.manager [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Took 18.09 seconds to build instance.
Nov 06 22:25:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance spawned successfully.
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:25:56 user nova-compute[75000]: INFO nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Took 15.73 seconds to spawn the instance on the hypervisor.
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8e496478-b975-45fc-948a-3c779c7b8c25 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "97e834ec-a286-4da9-a6b8-164a1061f042" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.459s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:25:56 user nova-compute[75000]: INFO nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Took 15.50 seconds to spawn the instance on the hypervisor.
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:25:56 user nova-compute[75000]: INFO nova.compute.manager [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Took 17.02 seconds to build instance.
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0b1c7c94-c93a-46c2-8cfd-db4274e23b16 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.200s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] No waiting events found dispatching network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:25:56 user nova-compute[75000]: WARNING nova.compute.manager [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received unexpected event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 for instance with vm_state active and task_state None.
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received event network-vif-plugged-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] Acquiring lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] No waiting events found dispatching network-vif-plugged-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:25:56 user nova-compute[75000]: WARNING nova.compute.manager [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received unexpected event network-vif-plugged-97af2be1-4e4d-414a-9233-ff6f508ebded for instance with vm_state active and task_state None.
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received event network-vif-plugged-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] Acquiring lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] No waiting events found dispatching network-vif-plugged-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:25:56 user nova-compute[75000]: WARNING nova.compute.manager [req-59018506-3572-428e-a0aa-dba796fcbe60 req-b141570a-97df-440e-b9f7-b87a1ca718b9 service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received unexpected event network-vif-plugged-97af2be1-4e4d-414a-9233-ff6f508ebded for instance with vm_state active and task_state None.
Nov 06 22:25:57 user nova-compute[75000]: INFO nova.compute.manager [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Took 16.85 seconds to build instance.
Nov 06 22:25:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f2e9bb95-d1e8-49af-8ad4-615ee5013857 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.058s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:25:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:25:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-9562d8fb-ef89-4dd9-ae6c-4e876a6373b9 req-2aacf5a2-93a7-45e6-acb5-dca20007138b service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9562d8fb-ef89-4dd9-ae6c-4e876a6373b9 req-2aacf5a2-93a7-45e6-acb5-dca20007138b service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9562d8fb-ef89-4dd9-ae6c-4e876a6373b9 req-2aacf5a2-93a7-45e6-acb5-dca20007138b service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9562d8fb-ef89-4dd9-ae6c-4e876a6373b9 req-2aacf5a2-93a7-45e6-acb5-dca20007138b service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-9562d8fb-ef89-4dd9-ae6c-4e876a6373b9 req-2aacf5a2-93a7-45e6-acb5-dca20007138b service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:03 user nova-compute[75000]: WARNING nova.compute.manager [req-9562d8fb-ef89-4dd9-ae6c-4e876a6373b9 req-2aacf5a2-93a7-45e6-acb5-dca20007138b service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state active and task_state None.
Nov 06 22:26:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:26:03 user nova-compute[75000]: INFO nova.compute.claims [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Claim successful on node user
Nov 06 22:26:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.707s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.402s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:26:04 user nova-compute[75000]: INFO nova.compute.claims [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Claim successful on node user
Nov 06 22:26:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:26:04 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:26:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:26:04 user nova-compute[75000]: DEBUG nova.policy [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb8b6cf0a5ff4e378b0b5e82360e6f4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781066e62dae49f786a6125637de0711', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:26:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Creating image(s)
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "/opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.021s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "/opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.268s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.921s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.261s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk 1073741824" returned: 0 in 0.072s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:05 user nova-compute[75000]: WARNING nova.compute.manager [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state active and task_state None.
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] No waiting events found dispatching network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:05 user nova-compute[75000]: WARNING nova.compute.manager [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received unexpected event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 for instance with vm_state active and task_state None.
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] No waiting events found dispatching network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:05 user nova-compute[75000]: WARNING nova.compute.manager [req-f8ff5e41-f6c9-46bf-bb15-d385bfc9df6b req-d56b7ae9-dd52-4e4f-9c62-73877c94cf9d service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received unexpected event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 for instance with vm_state active and task_state None.
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.policy [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ec398e2e7024fa894e326b719f249e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38efffece434857aa9ef955ba548942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.262s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:26:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:26:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Creating image(s)
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "/opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "/opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "/opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "810f37e366042aec470c90d5e9161624120ec7c4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "810f37e366042aec470c90d5e9161624120ec7c4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Cannot resize image /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Ensure instance console log exists: /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Successfully created port: 735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4.part --force-share --output=json" returned: 0 in 0.256s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG nova.virt.images [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] 3e7cc1de-cfa6-46d7-828b-bcad82651f76 was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4.part /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Successfully created port: a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4.part /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4.converted" returned: 0 in 0.211s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4.converted --force-share --output=json" returned: 0 in 0.296s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "810f37e366042aec470c90d5e9161624120ec7c4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.307s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4 --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "810f37e366042aec470c90d5e9161624120ec7c4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "810f37e366042aec470c90d5e9161624120ec7c4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4 --force-share --output=json" returned: 0 in 0.308s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4,backing_fmt=raw /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Successfully updated port: 735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4,backing_fmt=raw /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk 1073741824" returned: 0 in 0.076s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "810f37e366042aec470c90d5e9161624120ec7c4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.393s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "refresh_cache-a5f0aa50-4652-4cc3-9e59-899d32567a18" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquired lock "refresh_cache-a5f0aa50-4652-4cc3-9e59-899d32567a18" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-a01012cd-f7fa-455c-9210-68f58e74bfd3 req-275eebc1-e810-4472-9088-9e436c59c6b5 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received event network-changed-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-a01012cd-f7fa-455c-9210-68f58e74bfd3 req-275eebc1-e810-4472-9088-9e436c59c6b5 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Refreshing instance network info cache due to event network-changed-735dc42c-6666-426a-9739-2b1438b07175. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a01012cd-f7fa-455c-9210-68f58e74bfd3 req-275eebc1-e810-4472-9088-9e436c59c6b5 service nova] Acquiring lock "refresh_cache-a5f0aa50-4652-4cc3-9e59-899d32567a18" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4 --force-share --output=json" returned: 0 in 0.372s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Cannot resize image /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Ensure instance console log exists: /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Successfully updated port: a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "refresh_cache-5871774d-c8a5-4c72-81b1-d21b632996d3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquired lock "refresh_cache-5871774d-c8a5-4c72-81b1-d21b632996d3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Updating instance_info_cache with network_info: [{"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Releasing lock "refresh_cache-a5f0aa50-4652-4cc3-9e59-899d32567a18" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Instance network_info: |[{"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a01012cd-f7fa-455c-9210-68f58e74bfd3 req-275eebc1-e810-4472-9088-9e436c59c6b5 service nova] Acquired lock "refresh_cache-a5f0aa50-4652-4cc3-9e59-899d32567a18" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-a01012cd-f7fa-455c-9210-68f58e74bfd3 req-275eebc1-e810-4472-9088-9e436c59c6b5 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Refreshing network info cache for port 735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Start _get_guest_xml network_info=[{"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:26:09 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:09 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1721160334',display_name='tempest-TestVolumeSwap-server-1721160334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1721160334',id=7,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOhHCh6EJb7OnBC7GQhKg9G4IKIXr77LC8RniYpFCba/PnqnwNETCmE/aSE5+5sc1+naYOJMxdKVa8piEZCUHGcMCjqO0PISAhlg90s0SDOs5S387En0IRzTlKSt6i15Q==',key_name='tempest-keypair-867183940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='781066e62dae49f786a6125637de0711',ramdisk_id='',reservation_id='r-i6d0u06e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1693318627',owner_user_name='tempest-TestVolumeSwap-1693318627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb8b6cf0a5ff4e378b0b5e82360e6f4c',uuid=a5f0aa50-4652-4cc3-9e59-899d32567a18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Converting VIF {"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:dc:d0,bridge_name='br-int',has_traffic_filtering=True,id=735dc42c-6666-426a-9739-2b1438b07175,network=Network(e7f14970-b18e-43c3-bbf9-0675704763ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735dc42c-66') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.objects.instance [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lazy-loading 'pci_devices' on Instance uuid a5f0aa50-4652-4cc3-9e59-899d32567a18 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:26:09 user nova-compute[75000]:   <uuid>a5f0aa50-4652-4cc3-9e59-899d32567a18</uuid>
Nov 06 22:26:09 user nova-compute[75000]:   <name>instance-00000007</name>
Nov 06 22:26:09 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:26:09 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:26:09 user nova-compute[75000]:   <metadata>
Nov 06 22:26:09 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:26:09 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:26:09 user nova-compute[75000]:       <nova:name>tempest-TestVolumeSwap-server-1721160334</nova:name>
Nov 06 22:26:09 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:26:09</nova:creationTime>
Nov 06 22:26:09 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:26:09 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:26:09 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:26:09 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:26:09 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:26:09 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:26:09 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:26:09 user nova-compute[75000]:       <nova:owner>
Nov 06 22:26:09 user nova-compute[75000]:         <nova:user uuid="cb8b6cf0a5ff4e378b0b5e82360e6f4c">tempest-TestVolumeSwap-1693318627-project-member</nova:user>
Nov 06 22:26:09 user nova-compute[75000]:         <nova:project uuid="781066e62dae49f786a6125637de0711">tempest-TestVolumeSwap-1693318627</nova:project>
Nov 06 22:26:09 user nova-compute[75000]:       </nova:owner>
Nov 06 22:26:09 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:26:09 user nova-compute[75000]:       <nova:ports>
Nov 06 22:26:09 user nova-compute[75000]:         <nova:port uuid="735dc42c-6666-426a-9739-2b1438b07175">
Nov 06 22:26:09 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 22:26:09 user nova-compute[75000]:         </nova:port>
Nov 06 22:26:09 user nova-compute[75000]:       </nova:ports>
Nov 06 22:26:09 user nova-compute[75000]:     </nova:instance>
Nov 06 22:26:09 user nova-compute[75000]:   </metadata>
Nov 06 22:26:09 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:26:09 user nova-compute[75000]:     <system>
Nov 06 22:26:09 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:26:09 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:26:09 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:26:09 user nova-compute[75000]:       <entry name="serial">a5f0aa50-4652-4cc3-9e59-899d32567a18</entry>
Nov 06 22:26:09 user nova-compute[75000]:       <entry name="uuid">a5f0aa50-4652-4cc3-9e59-899d32567a18</entry>
Nov 06 22:26:09 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:26:09 user nova-compute[75000]:     </system>
Nov 06 22:26:09 user nova-compute[75000]:   </sysinfo>
Nov 06 22:26:09 user nova-compute[75000]:   <os>
Nov 06 22:26:09 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:26:09 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:26:09 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:26:09 user nova-compute[75000]:   </os>
Nov 06 22:26:09 user nova-compute[75000]:   <features>
Nov 06 22:26:09 user nova-compute[75000]:     <acpi/>
Nov 06 22:26:09 user nova-compute[75000]:     <apic/>
Nov 06 22:26:09 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:26:09 user nova-compute[75000]:   </features>
Nov 06 22:26:09 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:26:09 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:26:09 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:26:09 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:26:09 user nova-compute[75000]:   </clock>
Nov 06 22:26:09 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:26:09 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:26:09 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:26:09 user nova-compute[75000]:   </cpu>
Nov 06 22:26:09 user nova-compute[75000]:   <devices>
Nov 06 22:26:09 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:26:09 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:26:09 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk"/>
Nov 06 22:26:09 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:26:09 user nova-compute[75000]:     </disk>
Nov 06 22:26:09 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:26:09 user nova-compute[75000]:       <mac address="fa:16:3e:24:dc:d0"/>
Nov 06 22:26:09 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:26:09 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:26:09 user nova-compute[75000]:       <target dev="tap735dc42c-66"/>
Nov 06 22:26:09 user nova-compute[75000]:     </interface>
Nov 06 22:26:09 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:26:09 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/console.log" append="off"/>
Nov 06 22:26:09 user nova-compute[75000]:     </serial>
Nov 06 22:26:09 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:26:09 user nova-compute[75000]:     <video>
Nov 06 22:26:09 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:26:09 user nova-compute[75000]:     </video>
Nov 06 22:26:09 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:26:09 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:26:09 user nova-compute[75000]:     </rng>
Nov 06 22:26:09 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:26:09 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:26:09 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:26:09 user nova-compute[75000]:     </memballoon>
Nov 06 22:26:09 user nova-compute[75000]:   </devices>
Nov 06 22:26:09 user nova-compute[75000]: </domain>
Nov 06 22:26:09 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1721160334',display_name='tempest-TestVolumeSwap-server-1721160334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1721160334',id=7,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOhHCh6EJb7OnBC7GQhKg9G4IKIXr77LC8RniYpFCba/PnqnwNETCmE/aSE5+5sc1+naYOJMxdKVa8piEZCUHGcMCjqO0PISAhlg90s0SDOs5S387En0IRzTlKSt6i15Q==',key_name='tempest-keypair-867183940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='781066e62dae49f786a6125637de0711',ramdisk_id='',reservation_id='r-i6d0u06e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1693318627',owner_user_name='tempest-TestVolumeSwap-1693318627-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb8b6cf0a5ff4e378b0b5e82360e6f4c',uuid=a5f0aa50-4652-4cc3-9e59-899d32567a18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Converting VIF {"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:dc:d0,bridge_name='br-int',has_traffic_filtering=True,id=735dc42c-6666-426a-9739-2b1438b07175,network=Network(e7f14970-b18e-43c3-bbf9-0675704763ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735dc42c-66') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG os_vif [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:dc:d0,bridge_name='br-int',has_traffic_filtering=True,id=735dc42c-6666-426a-9739-2b1438b07175,network=Network(e7f14970-b18e-43c3-bbf9-0675704763ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735dc42c-66') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd17f986-cd8e-57cd-8349-b3d64e5bec65', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap735dc42c-66, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap735dc42c-66, col_values=(('qos', UUID('24200024-f0d8-406d-912c-287087361f57')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap735dc42c-66, col_values=(('external_ids', {'iface-id': '735dc42c-6666-426a-9739-2b1438b07175', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:dc:d0', 'vm-uuid': 'a5f0aa50-4652-4cc3-9e59-899d32567a18'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:09 user nova-compute[75000]: INFO os_vif [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:dc:d0,bridge_name='br-int',has_traffic_filtering=True,id=735dc42c-6666-426a-9739-2b1438b07175,network=Network(e7f14970-b18e-43c3-bbf9-0675704763ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735dc42c-66')
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:26:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] No VIF found with MAC fa:16:3e:24:dc:d0, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.network.neutron [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Updating instance_info_cache with network_info: [{"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Releasing lock "refresh_cache-5871774d-c8a5-4c72-81b1-d21b632996d3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Instance network_info: |[{"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Start _get_guest_xml network_info=[{"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:25:54Z,direct_url=<?>,disk_format='qcow2',id=3e7cc1de-cfa6-46d7-828b-bcad82651f76,min_disk=0,min_ram=0,name='',owner='49304a498e0a49919730a46755841bdc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:25:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'size': 0, 'boot_index': 0, 'device_name': '/dev/sda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '3e7cc1de-cfa6-46d7-828b-bcad82651f76'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:26:10 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:10 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:25:54Z,direct_url=<?>,disk_format='qcow2',id=3e7cc1de-cfa6-46d7-828b-bcad82651f76,min_disk=0,min_ram=0,name='',owner='49304a498e0a49919730a46755841bdc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:25:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1043361211',display_name='tempest-AttachSCSIVolumeTestJSON-server-1043361211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1043361211',id=8,image_ref='3e7cc1de-cfa6-46d7-828b-bcad82651f76',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhFzprvja1pQrEugjnx6yCWK9FwQqblBvoEARkZd2entkrXLH9sw3KMmfLvl7XKzYEI9DNWPpaQUjHOqLjZdISjHXl8gL68ALKFBWpFfO9mGXI3EgfrHRZJGNfs0DyjOQ==',key_name='tempest-keypair-1522934550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b38efffece434857aa9ef955ba548942',ramdisk_id='',reservation_id='r-34tcy7hr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3e7cc1de-cfa6-46d7-828b-bcad82651f76',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-410068501',owner_user_name='tempest-AttachSCSIVolumeTestJSON-410068501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ec398e2e7024fa894e326b719f249e5',uuid=5871774d-c8a5-4c72-81b1-d21b632996d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Converting VIF {"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4c:92,bridge_name='br-int',has_traffic_filtering=True,id=a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63,network=Network(6441bc90-b900-4807-8011-63a19ccc7c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6c9e8-3f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.objects.instance [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lazy-loading 'pci_devices' on Instance uuid 5871774d-c8a5-4c72-81b1-d21b632996d3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received event network-vif-plugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] Acquiring lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] No waiting events found dispatching network-vif-plugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:10 user nova-compute[75000]: WARNING nova.compute.manager [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received unexpected event network-vif-plugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e for instance with vm_state active and task_state None.
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received event network-changed-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Refreshing instance network info cache due to event network-changed-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] Acquiring lock "refresh_cache-5871774d-c8a5-4c72-81b1-d21b632996d3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] Acquired lock "refresh_cache-5871774d-c8a5-4c72-81b1-d21b632996d3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.network.neutron [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Refreshing network info cache for port a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:26:10 user nova-compute[75000]:   <uuid>5871774d-c8a5-4c72-81b1-d21b632996d3</uuid>
Nov 06 22:26:10 user nova-compute[75000]:   <name>instance-00000008</name>
Nov 06 22:26:10 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:26:10 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:26:10 user nova-compute[75000]:   <metadata>
Nov 06 22:26:10 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:26:10 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:26:10 user nova-compute[75000]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1043361211</nova:name>
Nov 06 22:26:10 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:26:10</nova:creationTime>
Nov 06 22:26:10 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:26:10 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:26:10 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:26:10 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:26:10 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:26:10 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:26:10 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:26:10 user nova-compute[75000]:       <nova:owner>
Nov 06 22:26:10 user nova-compute[75000]:         <nova:user uuid="3ec398e2e7024fa894e326b719f249e5">tempest-AttachSCSIVolumeTestJSON-410068501-project-member</nova:user>
Nov 06 22:26:10 user nova-compute[75000]:         <nova:project uuid="b38efffece434857aa9ef955ba548942">tempest-AttachSCSIVolumeTestJSON-410068501</nova:project>
Nov 06 22:26:10 user nova-compute[75000]:       </nova:owner>
Nov 06 22:26:10 user nova-compute[75000]:       <nova:root type="image" uuid="3e7cc1de-cfa6-46d7-828b-bcad82651f76"/>
Nov 06 22:26:10 user nova-compute[75000]:       <nova:ports>
Nov 06 22:26:10 user nova-compute[75000]:         <nova:port uuid="a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63">
Nov 06 22:26:10 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 22:26:10 user nova-compute[75000]:         </nova:port>
Nov 06 22:26:10 user nova-compute[75000]:       </nova:ports>
Nov 06 22:26:10 user nova-compute[75000]:     </nova:instance>
Nov 06 22:26:10 user nova-compute[75000]:   </metadata>
Nov 06 22:26:10 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:26:10 user nova-compute[75000]:     <system>
Nov 06 22:26:10 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:26:10 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:26:10 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:26:10 user nova-compute[75000]:       <entry name="serial">5871774d-c8a5-4c72-81b1-d21b632996d3</entry>
Nov 06 22:26:10 user nova-compute[75000]:       <entry name="uuid">5871774d-c8a5-4c72-81b1-d21b632996d3</entry>
Nov 06 22:26:10 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:26:10 user nova-compute[75000]:     </system>
Nov 06 22:26:10 user nova-compute[75000]:   </sysinfo>
Nov 06 22:26:10 user nova-compute[75000]:   <os>
Nov 06 22:26:10 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:26:10 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:26:10 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:26:10 user nova-compute[75000]:   </os>
Nov 06 22:26:10 user nova-compute[75000]:   <features>
Nov 06 22:26:10 user nova-compute[75000]:     <acpi/>
Nov 06 22:26:10 user nova-compute[75000]:     <apic/>
Nov 06 22:26:10 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:26:10 user nova-compute[75000]:   </features>
Nov 06 22:26:10 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:26:10 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:26:10 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:26:10 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:26:10 user nova-compute[75000]:   </clock>
Nov 06 22:26:10 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:26:10 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:26:10 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:26:10 user nova-compute[75000]:   </cpu>
Nov 06 22:26:10 user nova-compute[75000]:   <devices>
Nov 06 22:26:10 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:26:10 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:26:10 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk"/>
Nov 06 22:26:10 user nova-compute[75000]:       <target dev="sda" bus="scsi"/>
Nov 06 22:26:10 user nova-compute[75000]:       <address type="drive" controller="0" unit="0"/>
Nov 06 22:26:10 user nova-compute[75000]:     </disk>
Nov 06 22:26:10 user nova-compute[75000]:     <disk type="file" device="cdrom">
Nov 06 22:26:10 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 22:26:10 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk.config"/>
Nov 06 22:26:10 user nova-compute[75000]:       <target dev="sdb" bus="scsi"/>
Nov 06 22:26:10 user nova-compute[75000]:       <address type="drive" controller="0" unit="1"/>
Nov 06 22:26:10 user nova-compute[75000]:     </disk>
Nov 06 22:26:10 user nova-compute[75000]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 06 22:26:10 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:26:10 user nova-compute[75000]:       <mac address="fa:16:3e:0e:4c:92"/>
Nov 06 22:26:10 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:26:10 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:26:10 user nova-compute[75000]:       <target dev="tapa9e6c9e8-3f"/>
Nov 06 22:26:10 user nova-compute[75000]:     </interface>
Nov 06 22:26:10 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:26:10 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/console.log" append="off"/>
Nov 06 22:26:10 user nova-compute[75000]:     </serial>
Nov 06 22:26:10 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:26:10 user nova-compute[75000]:     <video>
Nov 06 22:26:10 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:26:10 user nova-compute[75000]:     </video>
Nov 06 22:26:10 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:26:10 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:26:10 user nova-compute[75000]:     </rng>
Nov 06 22:26:10 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:26:10 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:26:10 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:26:10 user nova-compute[75000]:     </memballoon>
Nov 06 22:26:10 user nova-compute[75000]:   </devices>
Nov 06 22:26:10 user nova-compute[75000]: </domain>
Nov 06 22:26:10 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1043361211',display_name='tempest-AttachSCSIVolumeTestJSON-server-1043361211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1043361211',id=8,image_ref='3e7cc1de-cfa6-46d7-828b-bcad82651f76',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhFzprvja1pQrEugjnx6yCWK9FwQqblBvoEARkZd2entkrXLH9sw3KMmfLvl7XKzYEI9DNWPpaQUjHOqLjZdISjHXl8gL68ALKFBWpFfO9mGXI3EgfrHRZJGNfs0DyjOQ==',key_name='tempest-keypair-1522934550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b38efffece434857aa9ef955ba548942',ramdisk_id='',reservation_id='r-34tcy7hr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3e7cc1de-cfa6-46d7-828b-bcad82651f76',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-410068501',owner_user_name='tempest-AttachSCSIVolumeTestJSON-410068501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ec398e2e7024fa894e326b719f249e5',uuid=5871774d-c8a5-4c72-81b1-d21b632996d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Converting VIF {"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4c:92,bridge_name='br-int',has_traffic_filtering=True,id=a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63,network=Network(6441bc90-b900-4807-8011-63a19ccc7c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6c9e8-3f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG os_vif [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4c:92,bridge_name='br-int',has_traffic_filtering=True,id=a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63,network=Network(6441bc90-b900-4807-8011-63a19ccc7c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6c9e8-3f') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54fe2df6-5554-5b00-92d1-9c5b6d10eb6a', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9e6c9e8-3f, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9e6c9e8-3f, col_values=(('qos', UUID('3443b7d5-b0cb-4380-a6e3-769e5e939160')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9e6c9e8-3f, col_values=(('external_ids', {'iface-id': 'a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:4c:92', 'vm-uuid': '5871774d-c8a5-4c72-81b1-d21b632996d3'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:10 user nova-compute[75000]: INFO os_vif [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:4c:92,bridge_name='br-int',has_traffic_filtering=True,id=a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63,network=Network(6441bc90-b900-4807-8011-63a19ccc7c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6c9e8-3f')
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] No BDM found with device name sda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:26:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] No VIF found with MAC fa:16:3e:0e:4c:92, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:26:10 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Using config drive
Nov 06 22:26:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-a01012cd-f7fa-455c-9210-68f58e74bfd3 req-275eebc1-e810-4472-9088-9e436c59c6b5 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Updated VIF entry in instance network info cache for port 735dc42c-6666-426a-9739-2b1438b07175. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-a01012cd-f7fa-455c-9210-68f58e74bfd3 req-275eebc1-e810-4472-9088-9e436c59c6b5 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Updating instance_info_cache with network_info: [{"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a01012cd-f7fa-455c-9210-68f58e74bfd3 req-275eebc1-e810-4472-9088-9e436c59c6b5 service nova] Releasing lock "refresh_cache-a5f0aa50-4652-4cc3-9e59-899d32567a18" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Creating config drive at /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk.config
Nov 06 22:26:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsv4r1xh0 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Updated VIF entry in instance network info cache for port a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Updating instance_info_cache with network_info: [{"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ca145b43-de36-4a30-ae94-8c56fa3fd481 req-1561973d-dde7-4a90-af31-f8f8fc985562 service nova] Releasing lock "refresh_cache-5871774d-c8a5-4c72-81b1-d21b632996d3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsv4r1xh0" returned: 0 in 0.081s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received event network-vif-plugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] Acquiring lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] No waiting events found dispatching network-vif-plugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:12 user nova-compute[75000]: WARNING nova.compute.manager [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received unexpected event network-vif-plugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e for instance with vm_state active and task_state None.
Nov 06 22:26:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:12 user nova-compute[75000]: WARNING nova.compute.manager [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state active and task_state None.
Nov 06 22:26:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:12 user nova-compute[75000]: WARNING nova.compute.manager [req-b67dbc61-4b78-4b19-855c-89c8bf746b7a req-467bbf09-0ca3-434f-a5c7-3683a98c2715 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state active and task_state None.
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:26:12 user nova-compute[75000]: INFO nova.compute.claims [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Claim successful on node user
Nov 06 22:26:13 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:26:13 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:26:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:13 user nova-compute[75000]: DEBUG nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:26:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:13 user nova-compute[75000]: DEBUG nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:26:13 user nova-compute[75000]: DEBUG nova.network.neutron [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:26:13 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:26:13 user nova-compute[75000]: DEBUG nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:26:14 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Creating image(s)
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG nova.policy [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fce02e55d5db4d6c84b122f1256be658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4353b17e66842a6a1b62609807babb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk 1073741824" returned: 0 in 0.127s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.214s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:26:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Cannot resize image /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Ensure instance console log exists: /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Successfully created port: 2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:26:15 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Instance spawned successfully.
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:15 user nova-compute[75000]: INFO nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Took 10.93 seconds to spawn the instance on the hypervisor.
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Successfully updated port: 2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquired lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-387a7d21-e1e1-47e4-8b34-cf0786bd480f req-c20e81a7-5a36-404e-8cbd-fe9efc851b4b service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-changed-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-387a7d21-e1e1-47e4-8b34-cf0786bd480f req-c20e81a7-5a36-404e-8cbd-fe9efc851b4b service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Refreshing instance network info cache due to event network-changed-2ca0b032-bdbe-441d-a684-454799aa6fbe. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-387a7d21-e1e1-47e4-8b34-cf0786bd480f req-c20e81a7-5a36-404e-8cbd-fe9efc851b4b service nova] Acquiring lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:16 user nova-compute[75000]: INFO nova.compute.manager [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Took 12.19 seconds to build instance.
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7b1c2a21-672f-41d1-a9e3-cef8034d33e8 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.444s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:26:16 user nova-compute[75000]: INFO nova.compute.claims [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Claim successful on node user
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updating instance_info_cache with network_info: [{"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Releasing lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Instance network_info: |[{"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-387a7d21-e1e1-47e4-8b34-cf0786bd480f req-c20e81a7-5a36-404e-8cbd-fe9efc851b4b service nova] Acquired lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-387a7d21-e1e1-47e4-8b34-cf0786bd480f req-c20e81a7-5a36-404e-8cbd-fe9efc851b4b service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Refreshing network info cache for port 2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Start _get_guest_xml network_info=[{"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:26:16 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:16 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:16 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Instance spawned successfully.
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1835765990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1835765990',id=9,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArjEIrT0n0OW5LPmXvMVh9DZ/o4Pi1O5TqTnxckxtr/cvCrVuTzdm4viQKjXknb6ohkpYfDUc8ANMcJJNVXr7cVx4raCgNYYfOxwMtwwTNWKbtPaAVCD3Pym+awkcbDRg==',key_name='tempest-keypair-1428121773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4353b17e66842a6a1b62609807babb2',ramdisk_id='',reservation_id='r-xypnink8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-22551579',owner_user_name='tempest-TaggedAttachmentsTest-22551579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce02e55d5db4d6c84b122f1256be658',uuid=5f0350b8-a2c5-49d4-ad89-69e68f8e70d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converting VIF {"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=2ca0b032-bdbe-441d-a684-454799aa6fbe,network=Network(e4d3ccbc-050f-43f0-845a-b85796b19f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca0b032-bd') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.objects.instance [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:26:16 user nova-compute[75000]:   <uuid>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</uuid>
Nov 06 22:26:16 user nova-compute[75000]:   <name>instance-00000009</name>
Nov 06 22:26:16 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:26:16 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:26:16 user nova-compute[75000]:   <metadata>
Nov 06 22:26:16 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:26:16 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:26:16 user nova-compute[75000]:       <nova:name>tempest-device-tagging-server-1835765990</nova:name>
Nov 06 22:26:16 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:26:16</nova:creationTime>
Nov 06 22:26:16 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:26:16 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:26:16 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:26:16 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:26:16 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:26:16 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:26:16 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:26:16 user nova-compute[75000]:       <nova:owner>
Nov 06 22:26:16 user nova-compute[75000]:         <nova:user uuid="fce02e55d5db4d6c84b122f1256be658">tempest-TaggedAttachmentsTest-22551579-project-member</nova:user>
Nov 06 22:26:16 user nova-compute[75000]:         <nova:project uuid="c4353b17e66842a6a1b62609807babb2">tempest-TaggedAttachmentsTest-22551579</nova:project>
Nov 06 22:26:16 user nova-compute[75000]:       </nova:owner>
Nov 06 22:26:16 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:26:16 user nova-compute[75000]:       <nova:ports>
Nov 06 22:26:16 user nova-compute[75000]:         <nova:port uuid="2ca0b032-bdbe-441d-a684-454799aa6fbe">
Nov 06 22:26:16 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:26:16 user nova-compute[75000]:         </nova:port>
Nov 06 22:26:16 user nova-compute[75000]:       </nova:ports>
Nov 06 22:26:16 user nova-compute[75000]:     </nova:instance>
Nov 06 22:26:16 user nova-compute[75000]:   </metadata>
Nov 06 22:26:16 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:26:16 user nova-compute[75000]:     <system>
Nov 06 22:26:16 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:26:16 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:26:16 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:26:16 user nova-compute[75000]:       <entry name="serial">5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:26:16 user nova-compute[75000]:       <entry name="uuid">5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:26:16 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:26:16 user nova-compute[75000]:     </system>
Nov 06 22:26:16 user nova-compute[75000]:   </sysinfo>
Nov 06 22:26:16 user nova-compute[75000]:   <os>
Nov 06 22:26:16 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:26:16 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:26:16 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:26:16 user nova-compute[75000]:   </os>
Nov 06 22:26:16 user nova-compute[75000]:   <features>
Nov 06 22:26:16 user nova-compute[75000]:     <acpi/>
Nov 06 22:26:16 user nova-compute[75000]:     <apic/>
Nov 06 22:26:16 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:26:16 user nova-compute[75000]:   </features>
Nov 06 22:26:16 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:26:16 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:26:16 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:26:16 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:26:16 user nova-compute[75000]:   </clock>
Nov 06 22:26:16 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:26:16 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:26:16 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:26:16 user nova-compute[75000]:   </cpu>
Nov 06 22:26:16 user nova-compute[75000]:   <devices>
Nov 06 22:26:16 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:26:16 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:26:16 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk"/>
Nov 06 22:26:16 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:26:16 user nova-compute[75000]:     </disk>
Nov 06 22:26:16 user nova-compute[75000]:     <disk type="file" device="cdrom">
Nov 06 22:26:16 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 22:26:16 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.config"/>
Nov 06 22:26:16 user nova-compute[75000]:       <target dev="hda" bus="ide"/>
Nov 06 22:26:16 user nova-compute[75000]:     </disk>
Nov 06 22:26:16 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:26:16 user nova-compute[75000]:       <mac address="fa:16:3e:66:34:1d"/>
Nov 06 22:26:16 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:26:16 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:26:16 user nova-compute[75000]:       <target dev="tap2ca0b032-bd"/>
Nov 06 22:26:16 user nova-compute[75000]:     </interface>
Nov 06 22:26:16 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:26:16 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log" append="off"/>
Nov 06 22:26:16 user nova-compute[75000]:     </serial>
Nov 06 22:26:16 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:26:16 user nova-compute[75000]:     <video>
Nov 06 22:26:16 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:26:16 user nova-compute[75000]:     </video>
Nov 06 22:26:16 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:26:16 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:26:16 user nova-compute[75000]:     </rng>
Nov 06 22:26:16 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:26:16 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:26:16 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:26:16 user nova-compute[75000]:     </memballoon>
Nov 06 22:26:16 user nova-compute[75000]:   </devices>
Nov 06 22:26:16 user nova-compute[75000]: </domain>
Nov 06 22:26:16 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1835765990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1835765990',id=9,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArjEIrT0n0OW5LPmXvMVh9DZ/o4Pi1O5TqTnxckxtr/cvCrVuTzdm4viQKjXknb6ohkpYfDUc8ANMcJJNVXr7cVx4raCgNYYfOxwMtwwTNWKbtPaAVCD3Pym+awkcbDRg==',key_name='tempest-keypair-1428121773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4353b17e66842a6a1b62609807babb2',ramdisk_id='',reservation_id='r-xypnink8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-22551579',owner_user_name='tempest-TaggedAttachmentsTest-22551579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce02e55d5db4d6c84b122f1256be658',uuid=5f0350b8-a2c5-49d4-ad89-69e68f8e70d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converting VIF {"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=2ca0b032-bdbe-441d-a684-454799aa6fbe,network=Network(e4d3ccbc-050f-43f0-845a-b85796b19f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca0b032-bd') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG os_vif [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=2ca0b032-bdbe-441d-a684-454799aa6fbe,network=Network(e4d3ccbc-050f-43f0-845a-b85796b19f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca0b032-bd') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78f7bf1f-8f09-53f0-8e77-b065eb5cfe94', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ca0b032-bd, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ca0b032-bd, col_values=(('qos', UUID('9f8c8bcb-58eb-4cc0-9ddf-f32da6d9c44a')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ca0b032-bd, col_values=(('external_ids', {'iface-id': '2ca0b032-bdbe-441d-a684-454799aa6fbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:34:1d', 'vm-uuid': '5f0350b8-a2c5-49d4-ad89-69e68f8e70d1'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:16 user nova-compute[75000]: INFO os_vif [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=2ca0b032-bdbe-441d-a684-454799aa6fbe,network=Network(e4d3ccbc-050f-43f0-845a-b85796b19f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca0b032-bd')
Nov 06 22:26:16 user nova-compute[75000]: INFO nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Took 10.66 seconds to spawn the instance on the hypervisor.
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] No BDM found with device name hda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:26:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] No VIF found with MAC fa:16:3e:66:34:1d, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:26:16 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Using config drive
Nov 06 22:26:17 user nova-compute[75000]: INFO nova.compute.manager [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Took 12.82 seconds to build instance.
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-601ddafb-d3e5-4ce9-9d7c-7450a94c31e7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.036s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Creating config drive at /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.config
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi7ivf2g9 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi7ivf2g9" returned: 0 in 0.069s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.network.neutron [req-387a7d21-e1e1-47e4-8b34-cf0786bd480f req-c20e81a7-5a36-404e-8cbd-fe9efc851b4b service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updated VIF entry in instance network info cache for port 2ca0b032-bdbe-441d-a684-454799aa6fbe. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.network.neutron [req-387a7d21-e1e1-47e4-8b34-cf0786bd480f req-c20e81a7-5a36-404e-8cbd-fe9efc851b4b service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updating instance_info_cache with network_info: [{"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.887s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-387a7d21-e1e1-47e4-8b34-cf0786bd480f req-c20e81a7-5a36-404e-8cbd-fe9efc851b4b service nova] Releasing lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.network.neutron [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:26:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.policy [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e064a43b46e473a8f0fc585751c4b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5bea61392f4b3ba79cb9bafd265a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:26:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Creating image(s)
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquiring lock "/opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "/opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "/opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.259s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received event network-vif-plugged-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] Acquiring lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] No waiting events found dispatching network-vif-plugged-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:18 user nova-compute[75000]: WARNING nova.compute.manager [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received unexpected event network-vif-plugged-735dc42c-6666-426a-9739-2b1438b07175 for instance with vm_state active and task_state None.
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received event network-vif-plugged-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] Acquiring lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] No waiting events found dispatching network-vif-plugged-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:18 user nova-compute[75000]: WARNING nova.compute.manager [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received unexpected event network-vif-plugged-735dc42c-6666-426a-9739-2b1438b07175 for instance with vm_state active and task_state None.
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received event network-vif-plugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] No waiting events found dispatching network-vif-plugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:18 user nova-compute[75000]: WARNING nova.compute.manager [req-db6dded0-340d-432b-8708-da89c01f915e req-d2eb4cff-4a3b-4feb-beba-2629d14a2c7e service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received unexpected event network-vif-plugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 for instance with vm_state active and task_state None.
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.289s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk 1073741824" returned: 0 in 0.058s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.353s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.254s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.network.neutron [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Successfully created port: 09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Cannot resize image /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Ensure instance console log exists: /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-c5fad6cb-7cc2-441b-94b3-934cf1b58508 req-489157e1-487d-4945-b284-7f75b30a8ce5 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c5fad6cb-7cc2-441b-94b3-934cf1b58508 req-489157e1-487d-4945-b284-7f75b30a8ce5 service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c5fad6cb-7cc2-441b-94b3-934cf1b58508 req-489157e1-487d-4945-b284-7f75b30a8ce5 service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c5fad6cb-7cc2-441b-94b3-934cf1b58508 req-489157e1-487d-4945-b284-7f75b30a8ce5 service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-c5fad6cb-7cc2-441b-94b3-934cf1b58508 req-489157e1-487d-4945-b284-7f75b30a8ce5 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:18 user nova-compute[75000]: WARNING nova.compute.manager [req-c5fad6cb-7cc2-441b-94b3-934cf1b58508 req-489157e1-487d-4945-b284-7f75b30a8ce5 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received unexpected event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe for instance with vm_state building and task_state spawning.
Nov 06 22:26:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-cba3b5ae-2189-4fb4-b924-3ee8b4683ef9 req-3cf1c506-7d4d-49d8-91cb-239f807dcefc service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received event network-vif-plugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cba3b5ae-2189-4fb4-b924-3ee8b4683ef9 req-3cf1c506-7d4d-49d8-91cb-239f807dcefc service nova] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cba3b5ae-2189-4fb4-b924-3ee8b4683ef9 req-3cf1c506-7d4d-49d8-91cb-239f807dcefc service nova] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cba3b5ae-2189-4fb4-b924-3ee8b4683ef9 req-3cf1c506-7d4d-49d8-91cb-239f807dcefc service nova] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-cba3b5ae-2189-4fb4-b924-3ee8b4683ef9 req-3cf1c506-7d4d-49d8-91cb-239f807dcefc service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] No waiting events found dispatching network-vif-plugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:20 user nova-compute[75000]: WARNING nova.compute.manager [req-cba3b5ae-2189-4fb4-b924-3ee8b4683ef9 req-3cf1c506-7d4d-49d8-91cb-239f807dcefc service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received unexpected event network-vif-plugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 for instance with vm_state active and task_state None.
Nov 06 22:26:20 user nova-compute[75000]: DEBUG nova.network.neutron [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Successfully updated port: 09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:26:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquiring lock "refresh_cache-28799760-9dec-46f7-abf1-03840c3bce4e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquired lock "refresh_cache-28799760-9dec-46f7-abf1-03840c3bce4e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:20 user nova-compute[75000]: DEBUG nova.network.neutron [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:26:20 user nova-compute[75000]: DEBUG nova.network.neutron [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-5c2b0138-7cea-49c4-8baa-44afe980d752 req-399111ea-3b61-43dd-aeac-2e37e5ccaa69 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5c2b0138-7cea-49c4-8baa-44afe980d752 req-399111ea-3b61-43dd-aeac-2e37e5ccaa69 service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5c2b0138-7cea-49c4-8baa-44afe980d752 req-399111ea-3b61-43dd-aeac-2e37e5ccaa69 service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5c2b0138-7cea-49c4-8baa-44afe980d752 req-399111ea-3b61-43dd-aeac-2e37e5ccaa69 service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-5c2b0138-7cea-49c4-8baa-44afe980d752 req-399111ea-3b61-43dd-aeac-2e37e5ccaa69 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:21 user nova-compute[75000]: WARNING nova.compute.manager [req-5c2b0138-7cea-49c4-8baa-44afe980d752 req-399111ea-3b61-43dd-aeac-2e37e5ccaa69 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received unexpected event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe for instance with vm_state building and task_state spawning.
Nov 06 22:26:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.network.neutron [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Updating instance_info_cache with network_info: [{"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Releasing lock "refresh_cache-28799760-9dec-46f7-abf1-03840c3bce4e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Instance network_info: |[{"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Start _get_guest_xml network_info=[{"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:21 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:21 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-142302469',display_name='tempest-VolumesAssistedSnapshotsTest-server-142302469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-142302469',id=10,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb9GABOJ0y7ov2HVoN53RQjY6BJuqwecAmH/yck7fGF7kd06FX0XSCJ3fM5Cri7SrYZTL5wjtMykV8lozKKIcXcx7WFl3EkIa1OOCnozQUYmLNMcN/yFXBZ9SPZkPdLfw==',key_name='tempest-keypair-1025431515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c5bea61392f4b3ba79cb9bafd265a3a',ramdisk_id='',reservation_id='r-k9vpuhhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1388042654',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1388042654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e064a43b46e473a8f0fc585751c4b60',uuid=28799760-9dec-46f7-abf1-03840c3bce4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Converting VIF {"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:84:1b,bridge_name='br-int',has_traffic_filtering=True,id=09e1bf50-5af1-48ea-b894-6e7d59ddfbd8,network=Network(56e74bb3-e3e0-4844-af7a-c238228b0fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e1bf50-5a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.objects.instance [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lazy-loading 'pci_devices' on Instance uuid 28799760-9dec-46f7-abf1-03840c3bce4e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:26:21 user nova-compute[75000]:   <uuid>28799760-9dec-46f7-abf1-03840c3bce4e</uuid>
Nov 06 22:26:21 user nova-compute[75000]:   <name>instance-0000000a</name>
Nov 06 22:26:21 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:26:21 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:26:21 user nova-compute[75000]:   <metadata>
Nov 06 22:26:21 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:26:21 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:26:21 user nova-compute[75000]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-142302469</nova:name>
Nov 06 22:26:21 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:26:21</nova:creationTime>
Nov 06 22:26:21 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:26:21 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:26:21 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:26:21 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:26:21 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:26:21 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:26:21 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:26:21 user nova-compute[75000]:       <nova:owner>
Nov 06 22:26:21 user nova-compute[75000]:         <nova:user uuid="7e064a43b46e473a8f0fc585751c4b60">tempest-VolumesAssistedSnapshotsTest-1388042654-project-member</nova:user>
Nov 06 22:26:21 user nova-compute[75000]:         <nova:project uuid="7c5bea61392f4b3ba79cb9bafd265a3a">tempest-VolumesAssistedSnapshotsTest-1388042654</nova:project>
Nov 06 22:26:21 user nova-compute[75000]:       </nova:owner>
Nov 06 22:26:21 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:26:21 user nova-compute[75000]:       <nova:ports>
Nov 06 22:26:21 user nova-compute[75000]:         <nova:port uuid="09e1bf50-5af1-48ea-b894-6e7d59ddfbd8">
Nov 06 22:26:21 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 22:26:21 user nova-compute[75000]:         </nova:port>
Nov 06 22:26:21 user nova-compute[75000]:       </nova:ports>
Nov 06 22:26:21 user nova-compute[75000]:     </nova:instance>
Nov 06 22:26:21 user nova-compute[75000]:   </metadata>
Nov 06 22:26:21 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:26:21 user nova-compute[75000]:     <system>
Nov 06 22:26:21 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:26:21 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:26:21 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:26:21 user nova-compute[75000]:       <entry name="serial">28799760-9dec-46f7-abf1-03840c3bce4e</entry>
Nov 06 22:26:21 user nova-compute[75000]:       <entry name="uuid">28799760-9dec-46f7-abf1-03840c3bce4e</entry>
Nov 06 22:26:21 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:26:21 user nova-compute[75000]:     </system>
Nov 06 22:26:21 user nova-compute[75000]:   </sysinfo>
Nov 06 22:26:21 user nova-compute[75000]:   <os>
Nov 06 22:26:21 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:26:21 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:26:21 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:26:21 user nova-compute[75000]:   </os>
Nov 06 22:26:21 user nova-compute[75000]:   <features>
Nov 06 22:26:21 user nova-compute[75000]:     <acpi/>
Nov 06 22:26:21 user nova-compute[75000]:     <apic/>
Nov 06 22:26:21 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:26:21 user nova-compute[75000]:   </features>
Nov 06 22:26:21 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:26:21 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:26:21 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:26:21 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:26:21 user nova-compute[75000]:   </clock>
Nov 06 22:26:21 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:26:21 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:26:21 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:26:21 user nova-compute[75000]:   </cpu>
Nov 06 22:26:21 user nova-compute[75000]:   <devices>
Nov 06 22:26:21 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:26:21 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:26:21 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk"/>
Nov 06 22:26:21 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:26:21 user nova-compute[75000]:     </disk>
Nov 06 22:26:21 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:26:21 user nova-compute[75000]:       <mac address="fa:16:3e:8a:84:1b"/>
Nov 06 22:26:21 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:26:21 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:26:21 user nova-compute[75000]:       <target dev="tap09e1bf50-5a"/>
Nov 06 22:26:21 user nova-compute[75000]:     </interface>
Nov 06 22:26:21 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:26:21 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/console.log" append="off"/>
Nov 06 22:26:21 user nova-compute[75000]:     </serial>
Nov 06 22:26:21 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:26:21 user nova-compute[75000]:     <video>
Nov 06 22:26:21 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:26:21 user nova-compute[75000]:     </video>
Nov 06 22:26:21 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:26:21 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:26:21 user nova-compute[75000]:     </rng>
Nov 06 22:26:21 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:26:21 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:26:21 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:26:21 user nova-compute[75000]:     </memballoon>
Nov 06 22:26:21 user nova-compute[75000]:   </devices>
Nov 06 22:26:21 user nova-compute[75000]: </domain>
Nov 06 22:26:21 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-142302469',display_name='tempest-VolumesAssistedSnapshotsTest-server-142302469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-142302469',id=10,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb9GABOJ0y7ov2HVoN53RQjY6BJuqwecAmH/yck7fGF7kd06FX0XSCJ3fM5Cri7SrYZTL5wjtMykV8lozKKIcXcx7WFl3EkIa1OOCnozQUYmLNMcN/yFXBZ9SPZkPdLfw==',key_name='tempest-keypair-1025431515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c5bea61392f4b3ba79cb9bafd265a3a',ramdisk_id='',reservation_id='r-k9vpuhhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1388042654',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1388042654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e064a43b46e473a8f0fc585751c4b60',uuid=28799760-9dec-46f7-abf1-03840c3bce4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Converting VIF {"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:84:1b,bridge_name='br-int',has_traffic_filtering=True,id=09e1bf50-5af1-48ea-b894-6e7d59ddfbd8,network=Network(56e74bb3-e3e0-4844-af7a-c238228b0fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e1bf50-5a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG os_vif [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:84:1b,bridge_name='br-int',has_traffic_filtering=True,id=09e1bf50-5af1-48ea-b894-6e7d59ddfbd8,network=Network(56e74bb3-e3e0-4844-af7a-c238228b0fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e1bf50-5a') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ebefcf8-cf39-540a-9f76-d0d4b46f9438', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09e1bf50-5a, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09e1bf50-5a, col_values=(('qos', UUID('2f4cf3d4-5d1b-458d-9f1a-f1c072750108')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09e1bf50-5a, col_values=(('external_ids', {'iface-id': '09e1bf50-5af1-48ea-b894-6e7d59ddfbd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:84:1b', 'vm-uuid': '28799760-9dec-46f7-abf1-03840c3bce4e'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:21 user nova-compute[75000]: INFO os_vif [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:84:1b,bridge_name='br-int',has_traffic_filtering=True,id=09e1bf50-5af1-48ea-b894-6e7d59ddfbd8,network=Network(56e74bb3-e3e0-4844-af7a-c238228b0fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e1bf50-5a')
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] No VIF found with MAC fa:16:3e:8a:84:1b, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:26:21 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Instance spawned successfully.
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:21 user nova-compute[75000]: INFO nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Took 7.84 seconds to spawn the instance on the hypervisor.
Nov 06 22:26:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:26:22 user nova-compute[75000]: INFO nova.compute.manager [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Took 9.28 seconds to build instance.
Nov 06 22:26:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-de27883b-d97b-4580-8779-9e84ad48fbf0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.440s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:22 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-4613aae1-c35d-4356-82ad-a3325348b451 req-81772619-86f8-4a23-9aba-0ec6b134d195 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received event network-changed-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-4613aae1-c35d-4356-82ad-a3325348b451 req-81772619-86f8-4a23-9aba-0ec6b134d195 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Refreshing instance network info cache due to event network-changed-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:26:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4613aae1-c35d-4356-82ad-a3325348b451 req-81772619-86f8-4a23-9aba-0ec6b134d195 service nova] Acquiring lock "refresh_cache-28799760-9dec-46f7-abf1-03840c3bce4e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4613aae1-c35d-4356-82ad-a3325348b451 req-81772619-86f8-4a23-9aba-0ec6b134d195 service nova] Acquired lock "refresh_cache-28799760-9dec-46f7-abf1-03840c3bce4e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:22 user nova-compute[75000]: DEBUG nova.network.neutron [req-4613aae1-c35d-4356-82ad-a3325348b451 req-81772619-86f8-4a23-9aba-0ec6b134d195 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Refreshing network info cache for port 09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-4613aae1-c35d-4356-82ad-a3325348b451 req-81772619-86f8-4a23-9aba-0ec6b134d195 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Updated VIF entry in instance network info cache for port 09e1bf50-5af1-48ea-b894-6e7d59ddfbd8. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-4613aae1-c35d-4356-82ad-a3325348b451 req-81772619-86f8-4a23-9aba-0ec6b134d195 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Updating instance_info_cache with network_info: [{"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4613aae1-c35d-4356-82ad-a3325348b451 req-81772619-86f8-4a23-9aba-0ec6b134d195 service nova] Releasing lock "refresh_cache-28799760-9dec-46f7-abf1-03840c3bce4e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Skipping network cache update for instance because it is Building. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid bf3bafdf-dba5-4961-a891-98f522b27f53 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-55296c7f-31bf-4e2b-a8cd-fb68f62da616 req-3ba6172e-e9a7-441f-be15-a4de92779350 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received event network-vif-plugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-55296c7f-31bf-4e2b-a8cd-fb68f62da616 req-3ba6172e-e9a7-441f-be15-a4de92779350 service nova] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-55296c7f-31bf-4e2b-a8cd-fb68f62da616 req-3ba6172e-e9a7-441f-be15-a4de92779350 service nova] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-55296c7f-31bf-4e2b-a8cd-fb68f62da616 req-3ba6172e-e9a7-441f-be15-a4de92779350 service nova] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-55296c7f-31bf-4e2b-a8cd-fb68f62da616 req-3ba6172e-e9a7-441f-be15-a4de92779350 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] No waiting events found dispatching network-vif-plugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:23 user nova-compute[75000]: WARNING nova.compute.manager [req-55296c7f-31bf-4e2b-a8cd-fb68f62da616 req-3ba6172e-e9a7-441f-be15-a4de92779350 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received unexpected event network-vif-plugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 for instance with vm_state building and task_state spawning.
Nov 06 22:26:24 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updating instance_info_cache with network_info: [{"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-a5638d02-fe31-49de-b43d-74937795457b req-8c242750-73a4-492a-ae7a-0043fc6b83a3 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received event network-vif-plugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a5638d02-fe31-49de-b43d-74937795457b req-8c242750-73a4-492a-ae7a-0043fc6b83a3 service nova] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a5638d02-fe31-49de-b43d-74937795457b req-8c242750-73a4-492a-ae7a-0043fc6b83a3 service nova] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a5638d02-fe31-49de-b43d-74937795457b req-8c242750-73a4-492a-ae7a-0043fc6b83a3 service nova] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-a5638d02-fe31-49de-b43d-74937795457b req-8c242750-73a4-492a-ae7a-0043fc6b83a3 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] No waiting events found dispatching network-vif-plugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:26:25 user nova-compute[75000]: WARNING nova.compute.manager [req-a5638d02-fe31-49de-b43d-74937795457b req-8c242750-73a4-492a-ae7a-0043fc6b83a3 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received unexpected event network-vif-plugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 for instance with vm_state building and task_state spawning.
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:26:26 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Instance spawned successfully.
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:26 user nova-compute[75000]: INFO nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Took 8.85 seconds to spawn the instance on the hypervisor.
Nov 06 22:26:26 user nova-compute[75000]: DEBUG nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:26 user nova-compute[75000]: INFO nova.compute.manager [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Took 10.37 seconds to build instance.
Nov 06 22:26:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-76311f2f-c1ba-4503-ab9f-d9493d63b7d6 tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.548s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.335s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:32 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:32 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:26:32 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7424MB free_disk=25.471256256103516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:26:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance acb2e909-770b-4cc5-822f-885cca107e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 846bf5e2-230c-419c-be77-982acc036b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance a5f0aa50-4652-4cc3-9e59-899d32567a18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 5871774d-c8a5-4c72-81b1-d21b632996d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 28799760-9dec-46f7-abf1-03840c3bce4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:26:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.018s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:26:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:26:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:26:57 user nova-compute[75000]: INFO nova.compute.claims [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Claim successful on node user
Nov 06 22:26:57 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:26:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:26:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:26:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:26:58 user nova-compute[75000]: DEBUG nova.policy [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f689ecfaa97f410b9ceea5760631957c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a1f61a8a6d4239ac6c506f63cc68d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:26:58 user nova-compute[75000]: INFO nova.virt.block_device [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Booting with volume 4c9e9ace-cfb8-4470-ab04-84269ea895dd at /dev/vda
Nov 06 22:26:58 user nova-compute[75000]: DEBUG os_brick.utils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:26:58 user nova-compute[75000]: INFO oslo.privsep.daemon [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptlqco7sw/privsep.sock']
Nov 06 22:26:58 user sudo[86568]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptlqco7sw/privsep.sock
Nov 06 22:26:58 user sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 22:26:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Successfully created port: 86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Successfully updated port: 86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "refresh_cache-0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquired lock "refresh_cache-0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-dd670452-cbdc-44d2-97de-3a06f0421200 req-78e55d4b-b432-410f-9bc4-3dddcfe9d8e8 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-changed-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-dd670452-cbdc-44d2-97de-3a06f0421200 req-78e55d4b-b432-410f-9bc4-3dddcfe9d8e8 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Refreshing instance network info cache due to event network-changed-86811d4a-20c1-4f36-898c-20b19c608073. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dd670452-cbdc-44d2-97de-3a06f0421200 req-78e55d4b-b432-410f-9bc4-3dddcfe9d8e8 service nova] Acquiring lock "refresh_cache-0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Updating instance_info_cache with network_info: [{"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Releasing lock "refresh_cache-0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance network_info: |[{"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dd670452-cbdc-44d2-97de-3a06f0421200 req-78e55d4b-b432-410f-9bc4-3dddcfe9d8e8 service nova] Acquired lock "refresh_cache-0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-dd670452-cbdc-44d2-97de-3a06f0421200 req-78e55d4b-b432-410f-9bc4-3dddcfe9d8e8 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Refreshing network info cache for port 86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:26:59 user sudo[86568]: pam_unix(sudo:session): session closed for user root
Nov 06 22:26:59 user nova-compute[75000]: INFO oslo.privsep.daemon [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Spawned new privsep daemon via rootwrap
Nov 06 22:26:59 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 22:26:59 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 22:26:59 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 06 22:26:59 user nova-compute[75000]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86571
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da757047-20be-4028-9bcf-1cc7a25b6500]: (2,) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b7a64-5a80-444c-adb8-40cc5f4af7db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:26:59 user nova-compute[75000]: WARNING os_brick.initiator.connectors.nvmeof [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b407b0e5-b8a7-4d59-8505-4267cdf297ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d804254d-6604-4957-b368-9bb979503a29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[13093ec4-f8c3-40f4-9a79-6019501122dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-dd670452-cbdc-44d2-97de-3a06f0421200 req-78e55d4b-b432-410f-9bc4-3dddcfe9d8e8 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Updated VIF entry in instance network info cache for port 86811d4a-20c1-4f36-898c-20b19c608073. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-dd670452-cbdc-44d2-97de-3a06f0421200 req-78e55d4b-b432-410f-9bc4-3dddcfe9d8e8 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Updating instance_info_cache with network_info: [{"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:26:59 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8788f47-d949-4789-a818-eaa20ab678bb]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG os_brick.utils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] <== get_connector_properties: return (1730ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Updating existing volume attachment record: 2e4aca1e-b8b2-48d8-9195-7d2ddbbc3607 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:26:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dd670452-cbdc-44d2-97de-3a06f0421200 req-78e55d4b-b432-410f-9bc4-3dddcfe9d8e8 service nova] Releasing lock "refresh_cache-0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:27:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:27:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:27:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:27:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:27:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:27:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:27:22 user nova-compute[75000]: INFO nova.compute.manager [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] instance snapshotting
Nov 06 22:27:22 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Beginning live snapshot process
Nov 06 22:27:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json -f qcow2 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json -f qcow2 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2ym20421/8e1e6645d7684eaa9333c0fbf7dca934.delta 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2ym20421/8e1e6645d7684eaa9333c0fbf7dca934.delta 1073741824" returned: 0 in 0.045s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:23 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 22:27:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75000) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 06 22:27:23 user nova-compute[75000]: INFO nova.virt.libvirt.host [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] UEFI support detected
Nov 06 22:27:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-acb2e909-770b-4cc5-822f-885cca107e1c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-acb2e909-770b-4cc5-822f-885cca107e1c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Updating instance_info_cache with network_info: [{"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-acb2e909-770b-4cc5-822f-885cca107e1c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:27:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 22:27:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 22:27:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 22:27:24 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:27:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2ym20421/8e1e6645d7684eaa9333c0fbf7dca934.delta /opt/stack/data/nova/instances/snapshots/tmp2ym20421/8e1e6645d7684eaa9333c0fbf7dca934 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2ym20421/8e1e6645d7684eaa9333c0fbf7dca934.delta /opt/stack/data/nova/instances/snapshots/tmp2ym20421/8e1e6645d7684eaa9333c0fbf7dca934" returned: 0 in 0.530s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Snapshot extracted, beginning image upload
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:27 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Snapshot image upload complete
Nov 06 22:27:27 user nova-compute[75000]: INFO nova.compute.manager [None req-a309f9ed-5a78-4a2e-a711-32d6e918f142 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Took 5.71 seconds to snapshot the instance on the hypervisor.
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e68e36d-a234-4890-bc0c-eaedd1200851 req-166cea55-88f0-46e4-8525-26d24fac9d3e service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received event network-changed-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e68e36d-a234-4890-bc0c-eaedd1200851 req-166cea55-88f0-46e4-8525-26d24fac9d3e service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Refreshing instance network info cache due to event network-changed-7a108ec5-3780-43e6-a8da-e1a44ecffd8e. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e68e36d-a234-4890-bc0c-eaedd1200851 req-166cea55-88f0-46e4-8525-26d24fac9d3e service nova] Acquiring lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e68e36d-a234-4890-bc0c-eaedd1200851 req-166cea55-88f0-46e4-8525-26d24fac9d3e service nova] Acquired lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG nova.network.neutron [req-9e68e36d-a234-4890-bc0c-eaedd1200851 req-166cea55-88f0-46e4-8525-26d24fac9d3e service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Refreshing network info cache for port 7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:27:29 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:27:29 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:27:29 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7048MB free_disk=25.315872192382812GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance acb2e909-770b-4cc5-822f-885cca107e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 846bf5e2-230c-419c-be77-982acc036b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance a5f0aa50-4652-4cc3-9e59-899d32567a18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 5871774d-c8a5-4c72-81b1-d21b632996d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 28799760-9dec-46f7-abf1-03840c3bce4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:27:30 user nova-compute[75000]: INFO nova.compute.manager [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Rescuing
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquired lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.network.neutron [req-9e68e36d-a234-4890-bc0c-eaedd1200851 req-166cea55-88f0-46e4-8525-26d24fac9d3e service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updated VIF entry in instance network info cache for port 7a108ec5-3780-43e6-a8da-e1a44ecffd8e. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.network.neutron [req-9e68e36d-a234-4890-bc0c-eaedd1200851 req-166cea55-88f0-46e4-8525-26d24fac9d3e service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updating instance_info_cache with network_info: [{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e68e36d-a234-4890-bc0c-eaedd1200851 req-166cea55-88f0-46e4-8525-26d24fac9d3e service nova] Releasing lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "acb2e909-770b-4cc5-822f-885cca107e1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lazy-loading 'flavor' on Instance uuid acb2e909-770b-4cc5-822f-885cca107e1c {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.164s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "acb2e909-770b-4cc5-822f-885cca107e1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:30 user nova-compute[75000]: INFO nova.compute.manager [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Attaching volume 19b31cb8-a40c-4b63-aef9-3622fea4ef51 to /dev/vdb
Nov 06 22:27:30 user nova-compute[75000]: DEBUG os_brick.utils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updating instance_info_cache with network_info: [{"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6410af-1cd7-4a09-bd2a-3169334fdc58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Releasing lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:27:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b32d4-21f9-4e6b-b620-0aeb52ac1548]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6f3d02-d2d0-40e0-a526-963f7ee93615]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffba5168-1300-4869-8cb6-c60e0fa9ab22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:27:31 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0140a865-f1e4-4aa0-b817-67dddca7a6b8]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG os_brick.utils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Updating existing volume attachment record: dda65579-5f1f-4da7-99b9-9a660a9eaa78 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:31 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Instance destroyed successfully.
Nov 06 22:27:31 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Attempting rescue
Nov 06 22:27:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Instance directory exists: not creating {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 22:27:31 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Creating image(s)
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'trusted_certs' on Instance uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received event network-vif-unplugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] No waiting events found dispatching network-vif-unplugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:27:31 user nova-compute[75000]: WARNING nova.compute.manager [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received unexpected event network-vif-unplugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 for instance with vm_state active and task_state rescuing.
Nov 06 22:27:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] No waiting events found dispatching network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:27:31 user nova-compute[75000]: WARNING nova.compute.manager [req-4a055f80-c370-4fac-bab0-3e78f8fa13ee req-f3157cab-74d5-40e6-a29a-8bdec4df6d60 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received unexpected event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 for instance with vm_state active and task_state rescuing.
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue" returned: 0 in 0.055s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'migration_context' on Instance uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.base [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<b2c6375a-d847-45e8-a0e8-42b37eb0af7f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Start _get_guest_xml network_info=[{"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "vif_mac": "fa:16:3e:54:00:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'resources' on Instance uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.base [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<b2c6375a-d847-45e8-a0e8-42b37eb0af7f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'numa_topology' on Instance uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.base [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<b2c6375a-d847-45e8-a0e8-42b37eb0af7f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:27:32 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:27:32 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'vcpu_model' on Instance uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-e5b5f784-0bf5-4076-a917-35969f79a101 req-707f82e1-0a9d-4972-a408-98861d3623b8 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-changed-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-e5b5f784-0bf5-4076-a917-35969f79a101 req-707f82e1-0a9d-4972-a408-98861d3623b8 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Refreshing instance network info cache due to event network-changed-f6cb1907-7cf4-46fd-9526-9c885c806ce2. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e5b5f784-0bf5-4076-a917-35969f79a101 req-707f82e1-0a9d-4972-a408-98861d3623b8 service nova] Acquiring lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e5b5f784-0bf5-4076-a917-35969f79a101 req-707f82e1-0a9d-4972-a408-98861d3623b8 service nova] Acquired lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.network.neutron [req-e5b5f784-0bf5-4076-a917-35969f79a101 req-707f82e1-0a9d-4972-a408-98861d3623b8 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Refreshing network info cache for port f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.base [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<b2c6375a-d847-45e8-a0e8-42b37eb0af7f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-627868483',display_name='tempest-ServerRescueNegativeTestJSON-server-627868483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-627868483',id=5,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:25:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-5y4ic5jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:57Z,user_data=None,user_id='f50e6a64752e488b9699a8bdda46253c',uuid=b2c6375a-d847-45e8-a0e8-42b37eb0af7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "vif_mac": "fa:16:3e:54:00:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "vif_mac": "fa:16:3e:54:00:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=031b54fe-fcfa-4d89-92fc-83adb16b5458,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031b54fe-fc') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.objects.base [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<b2c6375a-d847-45e8-a0e8-42b37eb0af7f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:27:32 user nova-compute[75000]:   <uuid>b2c6375a-d847-45e8-a0e8-42b37eb0af7f</uuid>
Nov 06 22:27:32 user nova-compute[75000]:   <name>instance-00000005</name>
Nov 06 22:27:32 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:27:32 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:27:32 user nova-compute[75000]:   <metadata>
Nov 06 22:27:32 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:27:32 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:27:32 user nova-compute[75000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-627868483</nova:name>
Nov 06 22:27:32 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:27:32</nova:creationTime>
Nov 06 22:27:32 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:27:32 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:27:32 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:27:32 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:27:32 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:27:32 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:27:32 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:27:32 user nova-compute[75000]:       <nova:owner>
Nov 06 22:27:32 user nova-compute[75000]:         <nova:user uuid="f50e6a64752e488b9699a8bdda46253c">tempest-ServerRescueNegativeTestJSON-259573853-project-member</nova:user>
Nov 06 22:27:32 user nova-compute[75000]:         <nova:project uuid="5b4b9d5ecee54acb8ca3534a38500b4f">tempest-ServerRescueNegativeTestJSON-259573853</nova:project>
Nov 06 22:27:32 user nova-compute[75000]:       </nova:owner>
Nov 06 22:27:32 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:27:32 user nova-compute[75000]:       <nova:ports>
Nov 06 22:27:32 user nova-compute[75000]:         <nova:port uuid="031b54fe-fcfa-4d89-92fc-83adb16b5458">
Nov 06 22:27:32 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 22:27:32 user nova-compute[75000]:         </nova:port>
Nov 06 22:27:32 user nova-compute[75000]:       </nova:ports>
Nov 06 22:27:32 user nova-compute[75000]:     </nova:instance>
Nov 06 22:27:32 user nova-compute[75000]:   </metadata>
Nov 06 22:27:32 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:27:32 user nova-compute[75000]:     <system>
Nov 06 22:27:32 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:27:32 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:27:32 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:27:32 user nova-compute[75000]:       <entry name="serial">b2c6375a-d847-45e8-a0e8-42b37eb0af7f</entry>
Nov 06 22:27:32 user nova-compute[75000]:       <entry name="uuid">b2c6375a-d847-45e8-a0e8-42b37eb0af7f</entry>
Nov 06 22:27:32 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:27:32 user nova-compute[75000]:     </system>
Nov 06 22:27:32 user nova-compute[75000]:   </sysinfo>
Nov 06 22:27:32 user nova-compute[75000]:   <os>
Nov 06 22:27:32 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:27:32 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:27:32 user nova-compute[75000]:   </os>
Nov 06 22:27:32 user nova-compute[75000]:   <features>
Nov 06 22:27:32 user nova-compute[75000]:     <acpi/>
Nov 06 22:27:32 user nova-compute[75000]:     <apic/>
Nov 06 22:27:32 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:27:32 user nova-compute[75000]:   </features>
Nov 06 22:27:32 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:27:32 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:27:32 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:27:32 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:27:32 user nova-compute[75000]:   </clock>
Nov 06 22:27:32 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:27:32 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:27:32 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:27:32 user nova-compute[75000]:   </cpu>
Nov 06 22:27:32 user nova-compute[75000]:   <devices>
Nov 06 22:27:32 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:27:32 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:27:32 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue"/>
Nov 06 22:27:32 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:27:32 user nova-compute[75000]:     </disk>
Nov 06 22:27:32 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:27:32 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:27:32 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk"/>
Nov 06 22:27:32 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:27:32 user nova-compute[75000]:     </disk>
Nov 06 22:27:32 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:27:32 user nova-compute[75000]:       <mac address="fa:16:3e:54:00:b6"/>
Nov 06 22:27:32 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:27:32 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:27:32 user nova-compute[75000]:       <target dev="tap031b54fe-fc"/>
Nov 06 22:27:32 user nova-compute[75000]:     </interface>
Nov 06 22:27:32 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:27:32 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/console.log" append="off"/>
Nov 06 22:27:32 user nova-compute[75000]:     </serial>
Nov 06 22:27:32 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:27:32 user nova-compute[75000]:     <video>
Nov 06 22:27:32 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:27:32 user nova-compute[75000]:     </video>
Nov 06 22:27:32 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:27:32 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:27:32 user nova-compute[75000]:     </rng>
Nov 06 22:27:32 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:27:32 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:27:32 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:27:32 user nova-compute[75000]:     </memballoon>
Nov 06 22:27:32 user nova-compute[75000]:   </devices>
Nov 06 22:27:32 user nova-compute[75000]: </domain>
Nov 06 22:27:32 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:27:32 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Instance destroyed successfully.
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No VIF found with MAC fa:16:3e:54:00:b6, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.network.neutron [req-e5b5f784-0bf5-4076-a917-35969f79a101 req-707f82e1-0a9d-4972-a408-98861d3623b8 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updated VIF entry in instance network info cache for port f6cb1907-7cf4-46fd-9526-9c885c806ce2. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG nova.network.neutron [req-e5b5f784-0bf5-4076-a917-35969f79a101 req-707f82e1-0a9d-4972-a408-98861d3623b8 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance_info_cache with network_info: [{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:27:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e5b5f784-0bf5-4076-a917-35969f79a101 req-707f82e1-0a9d-4972-a408-98861d3623b8 service nova] Releasing lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:27:33 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Creating image(s)
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Ensure instance console log exists: /opt/stack/data/nova/instances/0991271f-2087-4e6a-8fa7-fe29ddfa8ed7/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Start _get_guest_xml network_info=[{"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSODLmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0991271f-2087-4e6a-8fa7-fe29ddfa8ed7', 'attached_at': '', 'detached_at': '', 'volume_id': '4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'serial': '4c9e9ace-cfb8-4470-ab04-84269ea895dd'}, 'attachment_id': '2e4aca1e-b8b2-48d8-9195-7d2ddbbc3607', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:27:33 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:27:33 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connector [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Factory for ISCSI on None {{(pid=75000) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSODLmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:27:33 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:27:33 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:27:33 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7241e4a-2b9b-40c5-8c32-ed1f2dd8918b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:27:33 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38ce98b-c591-4218-ac58-b3e01222f6e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd] added
Nov 06 22:27:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b382a56-82a2-4526-97c4-8073eb6864a6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2626e8e-9cbf-4cd4-b725-9ff82bce0806]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSODLmeB {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSODLmeB" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf52473-7c01-4a4a-912f-4689449a3b24]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSODLmeB'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbfeca0-0a84-4a6c-8e80-c4a0dce1852c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eba2176-1c15-416e-b632-0917414f9514]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 22:27:33 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 22:27:33 user nova-compute[75000]:  {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:27:33 user nova-compute[75000]: WARNING os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 22:27:33 user nova-compute[75000]: 
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a3207c-2bd3-4c16-aabe-5887fa21c165]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260]
Nov 06 22:27:33 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260] successful.
Nov 06 22:27:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d533caf-6dca-4af3-a1da-7150b15767c7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4280d9d-3555-4729-b4fd-43c9e764a65a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:27:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:27:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[061b1587-9190-4fc9-af28-5f5aed187bb0]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSODLmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-0c3f304a-0c9d-41be-b483-efd1a328111a req-0564bb2b-2b9c-4e40-8ff0-5285a9200c78 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0c3f304a-0c9d-41be-b483-efd1a328111a req-0564bb2b-2b9c-4e40-8ff0-5285a9200c78 service nova] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0c3f304a-0c9d-41be-b483-efd1a328111a req-0564bb2b-2b9c-4e40-8ff0-5285a9200c78 service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0c3f304a-0c9d-41be-b483-efd1a328111a req-0564bb2b-2b9c-4e40-8ff0-5285a9200c78 service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-0c3f304a-0c9d-41be-b483-efd1a328111a req-0564bb2b-2b9c-4e40-8ff0-5285a9200c78 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] No waiting events found dispatching network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:27:34 user nova-compute[75000]: WARNING nova.compute.manager [req-0c3f304a-0c9d-41be-b483-efd1a328111a req-0564bb2b-2b9c-4e40-8ff0-5285a9200c78 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received unexpected event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 for instance with vm_state active and task_state rescuing.
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23862343431366439', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862343431366439', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-974537480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-974537480',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIby10utLlq64C+H0w0t6/RnIbsoLKrjjLWjuvHWYi0jYgcp6Sn19ciLh/GKqFYOykP4dfqlAYpSrwPN1t6AKylbp6fz517kU3tDTAViFlqnXC1l3fJO2sS1jDfUR8d4fg==',key_name='tempest-keypair-317477647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9a1f61a8a6d4239ac6c506f63cc68d2',ramdisk_id='',reservation_id='r-l4y2605r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-181120062',owner_user_name='tempest-ServerActionsV293TestJSON-181120062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f689ecfaa97f410b9ceea5760631957c',uuid=0991271f-2087-4e6a-8fa7-fe29ddfa8ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converting VIF {"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.objects.instance [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lazy-loading 'pci_devices' on Instance uuid 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:27:34 user nova-compute[75000]:   <uuid>0991271f-2087-4e6a-8fa7-fe29ddfa8ed7</uuid>
Nov 06 22:27:34 user nova-compute[75000]:   <name>instance-0000000b</name>
Nov 06 22:27:34 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:27:34 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:27:34 user nova-compute[75000]:   <metadata>
Nov 06 22:27:34 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:27:34 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:27:34 user nova-compute[75000]:       <nova:name>tempest-ServerActionsV293TestJSON-server-974537480</nova:name>
Nov 06 22:27:34 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:27:33</nova:creationTime>
Nov 06 22:27:34 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:27:34 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:27:34 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:27:34 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:27:34 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:27:34 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:27:34 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:27:34 user nova-compute[75000]:       <nova:owner>
Nov 06 22:27:34 user nova-compute[75000]:         <nova:user uuid="f689ecfaa97f410b9ceea5760631957c">tempest-ServerActionsV293TestJSON-181120062-project-member</nova:user>
Nov 06 22:27:34 user nova-compute[75000]:         <nova:project uuid="c9a1f61a8a6d4239ac6c506f63cc68d2">tempest-ServerActionsV293TestJSON-181120062</nova:project>
Nov 06 22:27:34 user nova-compute[75000]:       </nova:owner>
Nov 06 22:27:34 user nova-compute[75000]:       <nova:ports>
Nov 06 22:27:34 user nova-compute[75000]:         <nova:port uuid="86811d4a-20c1-4f36-898c-20b19c608073">
Nov 06 22:27:34 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 22:27:34 user nova-compute[75000]:         </nova:port>
Nov 06 22:27:34 user nova-compute[75000]:       </nova:ports>
Nov 06 22:27:34 user nova-compute[75000]:     </nova:instance>
Nov 06 22:27:34 user nova-compute[75000]:   </metadata>
Nov 06 22:27:34 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:27:34 user nova-compute[75000]:     <system>
Nov 06 22:27:34 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:27:34 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:27:34 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:27:34 user nova-compute[75000]:       <entry name="serial">0991271f-2087-4e6a-8fa7-fe29ddfa8ed7</entry>
Nov 06 22:27:34 user nova-compute[75000]:       <entry name="uuid">0991271f-2087-4e6a-8fa7-fe29ddfa8ed7</entry>
Nov 06 22:27:34 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:27:34 user nova-compute[75000]:     </system>
Nov 06 22:27:34 user nova-compute[75000]:   </sysinfo>
Nov 06 22:27:34 user nova-compute[75000]:   <os>
Nov 06 22:27:34 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:27:34 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:27:34 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:27:34 user nova-compute[75000]:   </os>
Nov 06 22:27:34 user nova-compute[75000]:   <features>
Nov 06 22:27:34 user nova-compute[75000]:     <acpi/>
Nov 06 22:27:34 user nova-compute[75000]:     <apic/>
Nov 06 22:27:34 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:27:34 user nova-compute[75000]:   </features>
Nov 06 22:27:34 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:27:34 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:27:34 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:27:34 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:27:34 user nova-compute[75000]:   </clock>
Nov 06 22:27:34 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:27:34 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:27:34 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:27:34 user nova-compute[75000]:   </cpu>
Nov 06 22:27:34 user nova-compute[75000]:   <devices>
Nov 06 22:27:34 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:27:34 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:27:34 user nova-compute[75000]:       <source dev="/dev/sdb"/>
Nov 06 22:27:34 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:27:34 user nova-compute[75000]:       <serial>4c9e9ace-cfb8-4470-ab04-84269ea895dd</serial>
Nov 06 22:27:34 user nova-compute[75000]:     </disk>
Nov 06 22:27:34 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:27:34 user nova-compute[75000]:       <mac address="fa:16:3e:84:76:b5"/>
Nov 06 22:27:34 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:27:34 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:27:34 user nova-compute[75000]:       <target dev="tap86811d4a-20"/>
Nov 06 22:27:34 user nova-compute[75000]:     </interface>
Nov 06 22:27:34 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:27:34 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/0991271f-2087-4e6a-8fa7-fe29ddfa8ed7/console.log" append="off"/>
Nov 06 22:27:34 user nova-compute[75000]:     </serial>
Nov 06 22:27:34 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:27:34 user nova-compute[75000]:     <video>
Nov 06 22:27:34 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:27:34 user nova-compute[75000]:     </video>
Nov 06 22:27:34 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:27:34 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:27:34 user nova-compute[75000]:     </rng>
Nov 06 22:27:34 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:27:34 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:27:34 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:27:34 user nova-compute[75000]:     </memballoon>
Nov 06 22:27:34 user nova-compute[75000]:   </devices>
Nov 06 22:27:34 user nova-compute[75000]: </domain>
Nov 06 22:27:34 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-974537480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-974537480',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIby10utLlq64C+H0w0t6/RnIbsoLKrjjLWjuvHWYi0jYgcp6Sn19ciLh/GKqFYOykP4dfqlAYpSrwPN1t6AKylbp6fz517kU3tDTAViFlqnXC1l3fJO2sS1jDfUR8d4fg==',key_name='tempest-keypair-317477647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9a1f61a8a6d4239ac6c506f63cc68d2',ramdisk_id='',reservation_id='r-l4y2605r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-181120062',owner_user_name='tempest-ServerActionsV293TestJSON-181120062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f689ecfaa97f410b9ceea5760631957c',uuid=0991271f-2087-4e6a-8fa7-fe29ddfa8ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converting VIF {"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG os_vif [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47bae2c7-757b-5bbe-bb78-b9a88e0dbe56', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86811d4a-20, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86811d4a-20, col_values=(('qos', UUID('77a3ad9b-a0fd-4002-bd39-a8be6f824cd5')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86811d4a-20, col_values=(('external_ids', {'iface-id': '86811d4a-20c1-4f36-898c-20b19c608073', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:76:b5', 'vm-uuid': '0991271f-2087-4e6a-8fa7-fe29ddfa8ed7'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:34 user nova-compute[75000]: INFO os_vif [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20')
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:27:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] No VIF found with MAC fa:16:3e:84:76:b5, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:27:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-47eaea7b-ff28-43f3-aea8-665b917d1d3b req-34689073-e8fa-4129-b59e-7f6a5f2a08e3 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-47eaea7b-ff28-43f3-aea8-665b917d1d3b req-34689073-e8fa-4129-b59e-7f6a5f2a08e3 service nova] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-47eaea7b-ff28-43f3-aea8-665b917d1d3b req-34689073-e8fa-4129-b59e-7f6a5f2a08e3 service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-47eaea7b-ff28-43f3-aea8-665b917d1d3b req-34689073-e8fa-4129-b59e-7f6a5f2a08e3 service nova] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-47eaea7b-ff28-43f3-aea8-665b917d1d3b req-34689073-e8fa-4129-b59e-7f6a5f2a08e3 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] No waiting events found dispatching network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:27:36 user nova-compute[75000]: WARNING nova.compute.manager [req-47eaea7b-ff28-43f3-aea8-665b917d1d3b req-34689073-e8fa-4129-b59e-7f6a5f2a08e3 service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received unexpected event network-vif-plugged-031b54fe-fcfa-4d89-92fc-83adb16b5458 for instance with vm_state active and task_state rescuing.
Nov 06 22:27:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a4d6889f-7d50-40aa-a1dd-52e65e9e6d10 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:27:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] No waiting events found dispatching network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:27:38 user nova-compute[75000]: WARNING nova.compute.manager [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received unexpected event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 for instance with vm_state building and task_state spawning.
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] No waiting events found dispatching network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:27:38 user nova-compute[75000]: WARNING nova.compute.manager [req-b27d5a10-e045-4783-9c2f-757d630fbbd1 req-5b45410b-6dc1-4da1-b251-351f2cc9bf3c service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received unexpected event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 for instance with vm_state building and task_state spawning.
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:27:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance spawned successfully.
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:27:38 user nova-compute[75000]: INFO nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 06 22:27:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:27:38 user nova-compute[75000]: INFO nova.compute.manager [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Took 41.40 seconds to build instance.
Nov 06 22:27:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fed3b04b-f251-405a-97ec-5fa041fe3174 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.523s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-6dcf17fc-009b-4af1-9ec2-3115d1768ac0 req-71ac67b3-2369-456a-ae3f-81ed23442d08 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received event network-changed-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-6dcf17fc-009b-4af1-9ec2-3115d1768ac0 req-71ac67b3-2369-456a-ae3f-81ed23442d08 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Refreshing instance network info cache due to event network-changed-735dc42c-6666-426a-9739-2b1438b07175. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6dcf17fc-009b-4af1-9ec2-3115d1768ac0 req-71ac67b3-2369-456a-ae3f-81ed23442d08 service nova] Acquiring lock "refresh_cache-a5f0aa50-4652-4cc3-9e59-899d32567a18" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6dcf17fc-009b-4af1-9ec2-3115d1768ac0 req-71ac67b3-2369-456a-ae3f-81ed23442d08 service nova] Acquired lock "refresh_cache-a5f0aa50-4652-4cc3-9e59-899d32567a18" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-6dcf17fc-009b-4af1-9ec2-3115d1768ac0 req-71ac67b3-2369-456a-ae3f-81ed23442d08 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Refreshing network info cache for port 735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG nova.objects.instance [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lazy-loading 'flavor' on Instance uuid a5f0aa50-4652-4cc3-9e59-899d32567a18 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:54 user nova-compute[75000]: INFO nova.compute.manager [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Attaching volume 012475a5-c864-4558-b06c-619198a3183c to /dev/vdb
Nov 06 22:27:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-6dcf17fc-009b-4af1-9ec2-3115d1768ac0 req-71ac67b3-2369-456a-ae3f-81ed23442d08 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Updated VIF entry in instance network info cache for port 735dc42c-6666-426a-9739-2b1438b07175. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-6dcf17fc-009b-4af1-9ec2-3115d1768ac0 req-71ac67b3-2369-456a-ae3f-81ed23442d08 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Updating instance_info_cache with network_info: [{"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6dcf17fc-009b-4af1-9ec2-3115d1768ac0 req-71ac67b3-2369-456a-ae3f-81ed23442d08 service nova] Releasing lock "refresh_cache-a5f0aa50-4652-4cc3-9e59-899d32567a18" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG os_brick.utils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff86e59-7d3e-41c2-8cac-3c652f478abc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aed526-c8b2-454c-a245-42b4a0a53fa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7d1197-5959-4021-9ca0-717fded27a9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0707b62a-23ac-4efc-bc33-4a5041fe5954]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:27:54 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:27:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58fc3a5-ab8e-493c-a216-8b6c379b7f4a]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG os_brick.utils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:27:54 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Updating existing volume attachment record: fdd810c1-661c-4ce8-8931-5dd02f35778f {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:27:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-d07c07f5-e12c-4459-92ea-fc13565e759f req-d8988f3a-ceb3-44d4-b9f1-0d44b3656e83 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received event network-changed-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-d07c07f5-e12c-4459-92ea-fc13565e759f req-d8988f3a-ceb3-44d4-b9f1-0d44b3656e83 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Refreshing instance network info cache due to event network-changed-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:27:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d07c07f5-e12c-4459-92ea-fc13565e759f req-d8988f3a-ceb3-44d4-b9f1-0d44b3656e83 service nova] Acquiring lock "refresh_cache-5871774d-c8a5-4c72-81b1-d21b632996d3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:27:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d07c07f5-e12c-4459-92ea-fc13565e759f req-d8988f3a-ceb3-44d4-b9f1-0d44b3656e83 service nova] Acquired lock "refresh_cache-5871774d-c8a5-4c72-81b1-d21b632996d3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:27:55 user nova-compute[75000]: DEBUG nova.network.neutron [req-d07c07f5-e12c-4459-92ea-fc13565e759f req-d8988f3a-ceb3-44d4-b9f1-0d44b3656e83 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Refreshing network info cache for port a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:27:55 user nova-compute[75000]: DEBUG nova.network.neutron [req-d07c07f5-e12c-4459-92ea-fc13565e759f req-d8988f3a-ceb3-44d4-b9f1-0d44b3656e83 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Updated VIF entry in instance network info cache for port a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:27:55 user nova-compute[75000]: DEBUG nova.network.neutron [req-d07c07f5-e12c-4459-92ea-fc13565e759f req-d8988f3a-ceb3-44d4-b9f1-0d44b3656e83 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Updating instance_info_cache with network_info: [{"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:27:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d07c07f5-e12c-4459-92ea-fc13565e759f req-d8988f3a-ceb3-44d4-b9f1-0d44b3656e83 service nova] Releasing lock "refresh_cache-5871774d-c8a5-4c72-81b1-d21b632996d3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wODhuHbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:27:56 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:27:56 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:27:56 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c385aea3-c39a-47ce-bf4c-186d64685d47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:27:56 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[622e9adb-649d-49de-9465-470853f3be6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51] added
Nov 06 22:27:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[23969ace-634f-4538-9e25-2a15cb7f40fd]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4dccb4-7a04-488d-95be-bf5d6bd8f759]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wODhuHbv {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wODhuHbv" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b02f6-ff6a-4cb9-a200-68a311e62660]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wODhuHbv'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d0f687-1457-4508-bd6b-2e685d780606]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea960b70-f260-4f7a-aa7d-f4d25bad054b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:27:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:27:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d5643a-5aab-4ae8-a918-a7ad5d98b5fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51, portal: 172.16.0.220,3260]
Nov 06 22:27:56 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51, portal: 172.16.0.220,3260] successful.
Nov 06 22:27:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e3104e-177c-47bc-9a68-63d5ce81c0a4]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecfec47-8755-4a3b-8887-451ab1dddb62]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:27:56 user nova-compute[75000]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 (non-flash)
Nov 06 22:27:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:27:56 user nova-compute[75000]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 (non-flash)
Nov 06 22:27:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87f81e-84dd-47ec-99b3-894ab6178b68]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:27:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wODhuHbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:27:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:27:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23737313765303763', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:27:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737313765303763', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:27:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lazy-loading 'flavor' on Instance uuid acb2e909-770b-4cc5-822f-885cca107e1c {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:27:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:27:57 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:27:57 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:27:57 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:27:57 user nova-compute[75000]:   <serial>19b31cb8-a40c-4b63-aef9-3622fea4ef51</serial>
Nov 06 22:27:57 user nova-compute[75000]: </disk>
Nov 06 22:27:57 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:27:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:27:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:27:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] No VIF found with MAC fa:16:3e:3b:60:7b, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:27:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8269cd94-1077-4eac-bb79-99661b78bd4d tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.938s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "acb2e909-770b-4cc5-822f-885cca107e1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:59 user nova-compute[75000]: INFO nova.compute.manager [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Terminating instance
Nov 06 22:27:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e40ce98-deeb-4507-80b5-7e59ad7fb29b req-e988e79a-6552-4dff-8f06-8ce910a6efbb service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received event network-vif-unplugged-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e40ce98-deeb-4507-80b5-7e59ad7fb29b req-e988e79a-6552-4dff-8f06-8ce910a6efbb service nova] Acquiring lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e40ce98-deeb-4507-80b5-7e59ad7fb29b req-e988e79a-6552-4dff-8f06-8ce910a6efbb service nova] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e40ce98-deeb-4507-80b5-7e59ad7fb29b req-e988e79a-6552-4dff-8f06-8ce910a6efbb service nova] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e40ce98-deeb-4507-80b5-7e59ad7fb29b req-e988e79a-6552-4dff-8f06-8ce910a6efbb service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] No waiting events found dispatching network-vif-unplugged-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:27:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e40ce98-deeb-4507-80b5-7e59ad7fb29b req-e988e79a-6552-4dff-8f06-8ce910a6efbb service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received event network-vif-unplugged-97af2be1-4e4d-414a-9233-ff6f508ebded for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:28:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Instance destroyed successfully.
Nov 06 22:28:00 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lazy-loading 'resources' on Instance uuid acb2e909-770b-4cc5-822f-885cca107e1c {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-331902863',display_name='tempest-DeleteServersTestJSON-server-331902863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-331902863',id=2,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:25:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4814d9e29ed84398857e2d6d26d8dd7d',ramdisk_id='',reservation_id='r-cbl4yl3k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1086801086',owner_user_name='tempest-DeleteServersTestJSON-1086801086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:25:52Z,user_data=None,user_id='3f0b714b7d304fbaa4b2c4252fbaecbd',uuid=acb2e909-770b-4cc5-822f-885cca107e1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Converting VIF {"id": "97af2be1-4e4d-414a-9233-ff6f508ebded", "address": "fa:16:3e:3b:60:7b", "network": {"id": "e699e63a-26c2-4755-8a8f-296162917325", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-829124425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4814d9e29ed84398857e2d6d26d8dd7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97af2be1-4e", "ovs_interfaceid": "97af2be1-4e4d-414a-9233-ff6f508ebded", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:60:7b,bridge_name='br-int',has_traffic_filtering=True,id=97af2be1-4e4d-414a-9233-ff6f508ebded,network=Network(e699e63a-26c2-4755-8a8f-296162917325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97af2be1-4e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_vif [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:60:7b,bridge_name='br-int',has_traffic_filtering=True,id=97af2be1-4e4d-414a-9233-ff6f508ebded,network=Network(e699e63a-26c2-4755-8a8f-296162917325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97af2be1-4e') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97af2be1-4e, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae51228d-d7cd-47c4-be94-9cd3f826562a) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:00 user nova-compute[75000]: INFO os_vif [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:60:7b,bridge_name='br-int',has_traffic_filtering=True,id=97af2be1-4e4d-414a-9233-ff6f508ebded,network=Network(e699e63a-26c2-4755-8a8f-296162917325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97af2be1-4e')
Nov 06 22:28:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wODhuHbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:00 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[550eeb2e-169a-44a2-8122-e68d33aabf6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:28:00 user nova-compute[75000]: No targets found.
Nov 06 22:28:00 user nova-compute[75000]: iSNS:
Nov 06 22:28:00 user nova-compute[75000]: No targets found.
Nov 06 22:28:00 user nova-compute[75000]: STATIC:
Nov 06 22:28:00 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51
Nov 06 22:28:00 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:00 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:00 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd
Nov 06 22:28:00 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:00 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:00 user nova-compute[75000]: FIRMWARE:
Nov 06 22:28:00 user nova-compute[75000]: No targets found.
Nov 06 22:28:00 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:28:00 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:28:00 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619d8b6-b4ca-461d-be82-315a06afdcbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afbf13c-ddf5-46c7-b86d-42e437103b83]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:00 user nova-compute[75000]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 (non-flash)
Nov 06 22:28:00 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:00 user nova-compute[75000]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 (non-flash)
Nov 06 22:28:00 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc7b51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5532e8-2818-4c53-a365-fec7254e856d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a539b517-4bb7-4000-bd00-59c6f8a1f143]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3262271-a866-4377-b2e1-3e318bc971c7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[291ff13c-c40d-4e2e-b84a-f5e5c27568a4]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[539ea6d2-773e-463b-b978-188a931e0262]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c500539f-720e-4a42-b973-45207484f3f8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51, portal: 172.16.0.220,3260]
Nov 06 22:28:00 user nova-compute[75000]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51, portal: 172.16.0.220,3260] successful.
Nov 06 22:28:00 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b31cb8-a40c-4b63-aef9-3622fea4ef51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2017d14d-c60d-4bb8-aa26-9685f3ed8844]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] <== disconnect_volume: return (362ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:28:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Deleting instance files /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c_del
Nov 06 22:28:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Deletion of /opt/stack/data/nova/instances/acb2e909-770b-4cc5-822f-885cca107e1c_del complete
Nov 06 22:28:00 user nova-compute[75000]: INFO nova.compute.manager [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 06 22:28:00 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:28:00 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:28:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-91fa098a-b5d1-4e55-ad72-ba3091a805dc req-0b1c5792-0e67-48ca-9944-cd4c09cd01f1 service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received event network-vif-plugged-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-91fa098a-b5d1-4e55-ad72-ba3091a805dc req-0b1c5792-0e67-48ca-9944-cd4c09cd01f1 service nova] Acquiring lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-91fa098a-b5d1-4e55-ad72-ba3091a805dc req-0b1c5792-0e67-48ca-9944-cd4c09cd01f1 service nova] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-91fa098a-b5d1-4e55-ad72-ba3091a805dc req-0b1c5792-0e67-48ca-9944-cd4c09cd01f1 service nova] Lock "acb2e909-770b-4cc5-822f-885cca107e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-91fa098a-b5d1-4e55-ad72-ba3091a805dc req-0b1c5792-0e67-48ca-9944-cd4c09cd01f1 service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] No waiting events found dispatching network-vif-plugged-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:01 user nova-compute[75000]: WARNING nova.compute.manager [req-91fa098a-b5d1-4e55-ad72-ba3091a805dc req-0b1c5792-0e67-48ca-9944-cd4c09cd01f1 service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received unexpected event network-vif-plugged-97af2be1-4e4d-414a-9233-ff6f508ebded for instance with vm_state active and task_state deleting.
Nov 06 22:28:01 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:01 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Took 1.13 seconds to deallocate network for instance.
Nov 06 22:28:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-5e44cae4-b480-4665-b416-3dd31d7f8161 req-92fe6f4d-5f12-4438-9863-a5b5bec0f44f service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Received event network-vif-deleted-97af2be1-4e4d-414a-9233-ff6f508ebded {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:01 user nova-compute[75000]: INFO nova.compute.manager [req-5e44cae4-b480-4665-b416-3dd31d7f8161 req-92fe6f4d-5f12-4438-9863-a5b5bec0f44f service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Neutron deleted interface 97af2be1-4e4d-414a-9233-ff6f508ebded; detaching it from the instance and deleting it from the info cache
Nov 06 22:28:01 user nova-compute[75000]: DEBUG nova.network.neutron [req-5e44cae4-b480-4665-b416-3dd31d7f8161 req-92fe6f4d-5f12-4438-9863-a5b5bec0f44f service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-5e44cae4-b480-4665-b416-3dd31d7f8161 req-92fe6f4d-5f12-4438-9863-a5b5bec0f44f service nova] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Detach interface failed, port_id=97af2be1-4e4d-414a-9233-ff6f508ebded, reason: Instance acb2e909-770b-4cc5-822f-885cca107e1c could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:28:02 user nova-compute[75000]: INFO nova.compute.manager [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] [instance: acb2e909-770b-4cc5-822f-885cca107e1c] Took 0.98 seconds to detach 1 volumes for instance.
Nov 06 22:28:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.volume.cinder [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Update attachment failed for attachment fdd810c1-661c-4ce8-8931-5dd02f35778f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4982ab68-f866-4aa1-8478-4c2a83966029) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4982ab68-f866-4aa1-8478-4c2a83966029)
Nov 06 22:28:03 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Failed to attach 012475a5-c864-4558-b06c-619198a3183c at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4982ab68-f866-4aa1-8478-4c2a83966029)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Traceback (most recent call last):
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     ret_val = method(obj, context, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     self._do_attach(context, instance, volume, volume_api,
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     self._volume_attach(context, volume, connector, instance,
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     connection_info = volume_api.attachment_update(
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     res = method(self, ctx, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     with excutils.save_and_reraise_exception():
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     self.force_reraise()
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     raise self.value
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     return method.func(obj, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     resp = self._update('/attachments/%s' % id, body)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     return self.request(url, method, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18]     raise exceptions.from_response(resp, body)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4982ab68-f866-4aa1-8478-4c2a83966029)
Nov 06 22:28:03 user nova-compute[75000]: ERROR nova.compute.manager [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] 
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:03 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Deleted allocations for instance acb2e909-770b-4cc5-822f-885cca107e1c
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.634s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c6fe8ed7-68be-4d0c-ac2b-0310c18763b1 tempest-DeleteServersTestJSON-1086801086 tempest-DeleteServersTestJSON-1086801086-project-member] Lock "acb2e909-770b-4cc5-822f-885cca107e1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.124s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server [None req-3fe9ed0d-00a8-4924-8179-55b91bce72f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4982ab68-f866-4aa1-8478-4c2a83966029)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4982ab68-f866-4aa1-8478-4c2a83966029)
Nov 06 22:28:03 user nova-compute[75000]: ERROR oslo_messaging.rpc.server 
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG nova.objects.instance [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lazy-loading 'flavor' on Instance uuid 5871774d-c8a5-4c72-81b1-d21b632996d3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-1b69cb4d-10f3-49f0-98d9-2140ecaf4bb8 req-9552c94a-b04f-419f-9f3c-548cbde911df service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-changed-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-1b69cb4d-10f3-49f0-98d9-2140ecaf4bb8 req-9552c94a-b04f-419f-9f3c-548cbde911df service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Refreshing instance network info cache due to event network-changed-2ca0b032-bdbe-441d-a684-454799aa6fbe. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1b69cb4d-10f3-49f0-98d9-2140ecaf4bb8 req-9552c94a-b04f-419f-9f3c-548cbde911df service nova] Acquiring lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1b69cb4d-10f3-49f0-98d9-2140ecaf4bb8 req-9552c94a-b04f-419f-9f3c-548cbde911df service nova] Acquired lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG nova.network.neutron [req-1b69cb4d-10f3-49f0-98d9-2140ecaf4bb8 req-9552c94a-b04f-419f-9f3c-548cbde911df service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Refreshing network info cache for port 2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:03 user nova-compute[75000]: INFO nova.compute.manager [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Attaching volume f8030b13-2139-4764-aa55-b6a7ce2440d5 to /dev/sdc
Nov 06 22:28:03 user nova-compute[75000]: DEBUG os_brick.utils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d6da5c-8510-4d73-8db5-e1287bc05684]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9e5fe-8364-408f-bfb4-41ced1785ceb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "interface-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "interface-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lazy-loading 'flavor' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed9123c-c23b-4933-8dd3-e34ea8aeb317]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd3bcaa-1ea0-43bb-ada0-76daee8648e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:28:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:28:04 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:28:04 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b18d88-2859-4f88-8969-a58706bd3a3d]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG os_brick.utils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Updating existing volume attachment record: 5186ff06-c365-4f2d-8584-3bb4c3c09d74 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lazy-loading 'pci_requests' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG nova.objects.base [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Object Instance<5f0350b8-a2c5-49d4-ad89-69e68f8e70d1> lazy-loaded attributes: flavor,pci_requests {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG nova.network.neutron [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG nova.network.neutron [req-1b69cb4d-10f3-49f0-98d9-2140ecaf4bb8 req-9552c94a-b04f-419f-9f3c-548cbde911df service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updated VIF entry in instance network info cache for port 2ca0b032-bdbe-441d-a684-454799aa6fbe. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG nova.network.neutron [req-1b69cb4d-10f3-49f0-98d9-2140ecaf4bb8 req-9552c94a-b04f-419f-9f3c-548cbde911df service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updating instance_info_cache with network_info: [{"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1b69cb4d-10f3-49f0-98d9-2140ecaf4bb8 req-9552c94a-b04f-419f-9f3c-548cbde911df service nova] Releasing lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG nova.policy [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fce02e55d5db4d6c84b122f1256be658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4353b17e66842a6a1b62609807babb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:28:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Successfully created port: e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:28:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Successfully updated port: e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquired lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG nova.compute.manager [req-a56d8c60-5548-45b1-a301-435103c1033d req-b728e223-8cde-446c-a3c1-9be934c71116 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-changed-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG nova.compute.manager [req-a56d8c60-5548-45b1-a301-435103c1033d req-b728e223-8cde-446c-a3c1-9be934c71116 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Refreshing instance network info cache due to event network-changed-e10592e9-45c1-4af2-a94a-9c7c6895cece. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a56d8c60-5548-45b1-a301-435103c1033d req-b728e223-8cde-446c-a3c1-9be934c71116 service nova] Acquiring lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updating instance_info_cache with network_info: [{"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Releasing lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a56d8c60-5548-45b1-a301-435103c1033d req-b728e223-8cde-446c-a3c1-9be934c71116 service nova] Acquired lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-a56d8c60-5548-45b1-a301-435103c1033d req-b728e223-8cde-446c-a3c1-9be934c71116 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Refreshing network info cache for port e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1835765990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1835765990',id=9,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArjEIrT0n0OW5LPmXvMVh9DZ/o4Pi1O5TqTnxckxtr/cvCrVuTzdm4viQKjXknb6ohkpYfDUc8ANMcJJNVXr7cVx4raCgNYYfOxwMtwwTNWKbtPaAVCD3Pym+awkcbDRg==',key_name='tempest-keypair-1428121773',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4353b17e66842a6a1b62609807babb2',ramdisk_id='',reservation_id='r-xypnink8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-22551579',owner_user_name='tempest-TaggedAttachmentsTest-22551579-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce02e55d5db4d6c84b122f1256be658',uuid=5f0350b8-a2c5-49d4-ad89-69e68f8e70d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converting VIF {"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG os_vif [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8eb34cb-3041-56f6-9ea6-bfee93b512bf', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape10592e9-45, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape10592e9-45, col_values=(('qos', UUID('7aec0123-50b3-48d6-8e90-eab7b6f00822')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape10592e9-45, col_values=(('external_ids', {'iface-id': 'e10592e9-45c1-4af2-a94a-9c7c6895cece', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:d9:84', 'vm-uuid': '5f0350b8-a2c5-49d4-ad89-69e68f8e70d1'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:07 user nova-compute[75000]: INFO os_vif [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45')
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1835765990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1835765990',id=9,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArjEIrT0n0OW5LPmXvMVh9DZ/o4Pi1O5TqTnxckxtr/cvCrVuTzdm4viQKjXknb6ohkpYfDUc8ANMcJJNVXr7cVx4raCgNYYfOxwMtwwTNWKbtPaAVCD3Pym+awkcbDRg==',key_name='tempest-keypair-1428121773',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4353b17e66842a6a1b62609807babb2',ramdisk_id='',reservation_id='r-xypnink8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-22551579',owner_user_name='tempest-TaggedAttachmentsTest-22551579-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce02e55d5db4d6c84b122f1256be658',uuid=5f0350b8-a2c5-49d4-ad89-69e68f8e70d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converting VIF {"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] attach device xml: <interface type="ethernet">
Nov 06 22:28:07 user nova-compute[75000]:   <mac address="fa:16:3e:e7:d9:84"/>
Nov 06 22:28:07 user nova-compute[75000]:   <model type="virtio"/>
Nov 06 22:28:07 user nova-compute[75000]:   <mtu size="1442"/>
Nov 06 22:28:07 user nova-compute[75000]:   <target dev="tape10592e9-45"/>
Nov 06 22:28:07 user nova-compute[75000]: </interface>
Nov 06 22:28:07 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] No BDM found with device name hda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] No VIF found with MAC fa:16:3e:66:34:1d, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:28:07 user nova-compute[75000]:   <nova:package version="0.0.0"/>
Nov 06 22:28:07 user nova-compute[75000]:   <nova:name>tempest-device-tagging-server-1835765990</nova:name>
Nov 06 22:28:07 user nova-compute[75000]:   <nova:creationTime>2023-11-06 22:28:07</nova:creationTime>
Nov 06 22:28:07 user nova-compute[75000]:   <nova:flavor name="m1.tiny">
Nov 06 22:28:07 user nova-compute[75000]:     <nova:memory>512</nova:memory>
Nov 06 22:28:07 user nova-compute[75000]:     <nova:disk>1</nova:disk>
Nov 06 22:28:07 user nova-compute[75000]:     <nova:swap>0</nova:swap>
Nov 06 22:28:07 user nova-compute[75000]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:28:07 user nova-compute[75000]:     <nova:vcpus>1</nova:vcpus>
Nov 06 22:28:07 user nova-compute[75000]:   </nova:flavor>
Nov 06 22:28:07 user nova-compute[75000]:   <nova:owner>
Nov 06 22:28:07 user nova-compute[75000]:     <nova:user uuid="fce02e55d5db4d6c84b122f1256be658">tempest-TaggedAttachmentsTest-22551579-project-member</nova:user>
Nov 06 22:28:07 user nova-compute[75000]:     <nova:project uuid="c4353b17e66842a6a1b62609807babb2">tempest-TaggedAttachmentsTest-22551579</nova:project>
Nov 06 22:28:07 user nova-compute[75000]:   </nova:owner>
Nov 06 22:28:07 user nova-compute[75000]:   <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:28:07 user nova-compute[75000]:   <nova:ports>
Nov 06 22:28:07 user nova-compute[75000]:     <nova:port uuid="2ca0b032-bdbe-441d-a684-454799aa6fbe">
Nov 06 22:28:07 user nova-compute[75000]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:28:07 user nova-compute[75000]:     </nova:port>
Nov 06 22:28:07 user nova-compute[75000]:     <nova:port uuid="e10592e9-45c1-4af2-a94a-9c7c6895cece">
Nov 06 22:28:07 user nova-compute[75000]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 06 22:28:07 user nova-compute[75000]:     </nova:port>
Nov 06 22:28:07 user nova-compute[75000]:   </nova:ports>
Nov 06 22:28:07 user nova-compute[75000]: </nova:instance>
Nov 06 22:28:07 user nova-compute[75000]:  {{(pid=75000) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-618de773-63df-45de-b768-3af2c11422cc req-ce501378-ae88-4f3e-bf6f-05785735afc9 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received event network-changed-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-618de773-63df-45de-b768-3af2c11422cc req-ce501378-ae88-4f3e-bf6f-05785735afc9 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Refreshing instance network info cache due to event network-changed-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-618de773-63df-45de-b768-3af2c11422cc req-ce501378-ae88-4f3e-bf6f-05785735afc9 service nova] Acquiring lock "refresh_cache-28799760-9dec-46f7-abf1-03840c3bce4e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-618de773-63df-45de-b768-3af2c11422cc req-ce501378-ae88-4f3e-bf6f-05785735afc9 service nova] Acquired lock "refresh_cache-28799760-9dec-46f7-abf1-03840c3bce4e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-618de773-63df-45de-b768-3af2c11422cc req-ce501378-ae88-4f3e-bf6f-05785735afc9 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Refreshing network info cache for port 09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e2e23d98-c1a4-43a7-a2d9-fef08cbc22a2 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "interface-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.656s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-a56d8c60-5548-45b1-a301-435103c1033d req-b728e223-8cde-446c-a3c1-9be934c71116 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updated VIF entry in instance network info cache for port e10592e9-45c1-4af2-a94a-9c7c6895cece. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-a56d8c60-5548-45b1-a301-435103c1033d req-b728e223-8cde-446c-a3c1-9be934c71116 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updating instance_info_cache with network_info: [{"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a56d8c60-5548-45b1-a301-435103c1033d req-b728e223-8cde-446c-a3c1-9be934c71116 service nova] Releasing lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG nova.objects.instance [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lazy-loading 'flavor' on Instance uuid 28799760-9dec-46f7-abf1-03840c3bce4e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG nova.objects.instance [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lazy-loading 'flavor' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-618de773-63df-45de-b768-3af2c11422cc req-ce501378-ae88-4f3e-bf6f-05785735afc9 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Updated VIF entry in instance network info cache for port 09e1bf50-5af1-48ea-b894-6e7d59ddfbd8. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-618de773-63df-45de-b768-3af2c11422cc req-ce501378-ae88-4f3e-bf6f-05785735afc9 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Updating instance_info_cache with network_info: [{"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:08 user nova-compute[75000]: INFO nova.compute.manager [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Attaching volume 5d859962-5ba1-4819-b7f1-167849872a6d to /dev/vdb
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-618de773-63df-45de-b768-3af2c11422cc req-ce501378-ae88-4f3e-bf6f-05785735afc9 service nova] Releasing lock "refresh_cache-28799760-9dec-46f7-abf1-03840c3bce4e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.utils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:08 user nova-compute[75000]: INFO nova.compute.manager [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Attaching volume 4b4cbacf-5614-49b3-858a-b2124aba6ce2 to /dev/vdb
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6846f492-b0d1-4473-83ae-6b76b430019b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b2aed9-a834-45fc-ad96-927776669dc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[722e1b34-0d50-4fa0-b3c8-8bdbef4f5a86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[89deec5c-905f-4f27-8e3b-04562f7c659b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.utils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73124ee8-5c90-4f0d-9752-a019748a346f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:28:08 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e12f40-a369-4ca3-9943-845f141b563e]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.utils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Updating existing volume attachment record: e20415d3-3dde-45b2-9a53-7604d6e85944 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97f16fc-f4c3-4e25-bd77-be642478586f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc66b28-0c14-4432-93c5-2efbb04e111e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b8c110-960b-4994-97ee-8748f6597abe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:28:08 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:28:08 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3206bd-fd71-44f9-9b0e-13c4b4a4da15]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG os_brick.utils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:08 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updating existing volume attachment record: 2f52441e-0c37-4099-8c5a-bf38f6078b47 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:28:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-cab3c52b-5123-47f0-90b2-ec50c5a94c06 req-61011f5f-1d7e-4ac4-aba5-7b88a56ee58e service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-plugged-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cab3c52b-5123-47f0-90b2-ec50c5a94c06 req-61011f5f-1d7e-4ac4-aba5-7b88a56ee58e service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cab3c52b-5123-47f0-90b2-ec50c5a94c06 req-61011f5f-1d7e-4ac4-aba5-7b88a56ee58e service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cab3c52b-5123-47f0-90b2-ec50c5a94c06 req-61011f5f-1d7e-4ac4-aba5-7b88a56ee58e service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-cab3c52b-5123-47f0-90b2-ec50c5a94c06 req-61011f5f-1d7e-4ac4-aba5-7b88a56ee58e service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-plugged-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:10 user nova-compute[75000]: WARNING nova.compute.manager [req-cab3c52b-5123-47f0-90b2-ec50c5a94c06 req-61011f5f-1d7e-4ac4-aba5-7b88a56ee58e service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received unexpected event network-vif-plugged-e10592e9-45c1-4af2-a94a-9c7c6895cece for instance with vm_state active and task_state None.
Nov 06 22:28:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-b7509c9a-6f90-4cbd-b2f1-a1520e851215 req-a44efdb7-38b2-4885-8160-b2272dfdf59a service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-plugged-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b7509c9a-6f90-4cbd-b2f1-a1520e851215 req-a44efdb7-38b2-4885-8160-b2272dfdf59a service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b7509c9a-6f90-4cbd-b2f1-a1520e851215 req-a44efdb7-38b2-4885-8160-b2272dfdf59a service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b7509c9a-6f90-4cbd-b2f1-a1520e851215 req-a44efdb7-38b2-4885-8160-b2272dfdf59a service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-b7509c9a-6f90-4cbd-b2f1-a1520e851215 req-a44efdb7-38b2-4885-8160-b2272dfdf59a service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-plugged-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:12 user nova-compute[75000]: WARNING nova.compute.manager [req-b7509c9a-6f90-4cbd-b2f1-a1520e851215 req-a44efdb7-38b2-4885-8160-b2272dfdf59a service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received unexpected event network-vif-plugged-e10592e9-45c1-4af2-a94a-9c7c6895cece for instance with vm_state active and task_state None.
Nov 06 22:28:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:28:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:28:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updating instance_info_cache with network_info: [{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdHOrztZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:25 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:25 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:25 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69344ec8-5f93-4272-a609-e8a884d60e40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:28:25 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd84aae-8009-437c-ad83-2b1880799824]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5] added
Nov 06 22:28:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[273a001d-46db-46b8-a21c-8510157a3d68]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5febc749-023b-4f51-89b4-cfe760e27a98]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdHOrztZ {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KdHOrztZ" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baee461-0e0d-4065-8733-26a03870a022]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KdHOrztZ'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d388f5-0897-4bfb-8fb6-17d898a5c47c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecba8d3e-47e1-4ccc-bbf1-fd5133dab16d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed675648-6e59-4469-91a7-1bb8c37f9a10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5, portal: 172.16.0.220,3260]
Nov 06 22:28:26 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5, portal: 172.16.0.220,3260] successful.
Nov 06 22:28:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[18893664-5512-480b-8b13-7a41e83bc8ca]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cbc829-878d-4a3e-84f9-72d1fa072078]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:26 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:26 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17432d9-de92-4161-974d-5a989993326d]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdHOrztZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:28:27 user nova-compute[75000]: INFO nova.compute.claims [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Claim successful on node user
Nov 06 22:28:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23830323230316366', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830323230316366', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG nova.objects.instance [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lazy-loading 'flavor' on Instance uuid 5871774d-c8a5-4c72-81b1-d21b632996d3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:28:27 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:28:27 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:28:27 user nova-compute[75000]:   <target dev="sdc" bus="scsi"/>
Nov 06 22:28:27 user nova-compute[75000]:   <serial>f8030b13-2139-4764-aa55-b6a7ce2440d5</serial>
Nov 06 22:28:27 user nova-compute[75000]:   <address type="drive" controller="0" unit="2"/>
Nov 06 22:28:27 user nova-compute[75000]: </disk>
Nov 06 22:28:27 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.853s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json" returned: 0 in 0.485s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.network.neutron [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] No BDM found with device name sda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] No VIF found with MAC fa:16:3e:0e:4c:92, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.policy [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afc6c795f94d4469825b1ceac5bb2ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f0e789571a4a63b90b26c9a5b0c954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:28:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5177f78c-ca75-4870-9b11-b616d3f73e1c tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.464s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:28:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Creating image(s)
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "/opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "/opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.network.neutron [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Successfully created port: aa0e773f-8a3e-4e26-b935-4e993cbf6c5b {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk 1073741824" returned: 0 in 0.052s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Cannot resize image /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Ensure instance console log exists: /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG nova.network.neutron [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Successfully updated port: aa0e773f-8a3e-4e26-b935-4e993cbf6c5b {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-bbf1b395-7442-4af0-ab31-b6bd6afc12b0 req-9cd7ac44-2099-495b-a937-1fa2f299dbbb service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Received event network-changed-aa0e773f-8a3e-4e26-b935-4e993cbf6c5b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-bbf1b395-7442-4af0-ab31-b6bd6afc12b0 req-9cd7ac44-2099-495b-a937-1fa2f299dbbb service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Refreshing instance network info cache due to event network-changed-aa0e773f-8a3e-4e26-b935-4e993cbf6c5b. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bbf1b395-7442-4af0-ab31-b6bd6afc12b0 req-9cd7ac44-2099-495b-a937-1fa2f299dbbb service nova] Acquiring lock "refresh_cache-6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bbf1b395-7442-4af0-ab31-b6bd6afc12b0 req-9cd7ac44-2099-495b-a937-1fa2f299dbbb service nova] Acquired lock "refresh_cache-6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG nova.network.neutron [req-bbf1b395-7442-4af0-ab31-b6bd6afc12b0 req-9cd7ac44-2099-495b-a937-1fa2f299dbbb service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Refreshing network info cache for port aa0e773f-8a3e-4e26-b935-4e993cbf6c5b {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG nova.network.neutron [req-bbf1b395-7442-4af0-ab31-b6bd6afc12b0 req-9cd7ac44-2099-495b-a937-1fa2f299dbbb service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "refresh_cache-6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:29 user nova-compute[75000]: INFO nova.compute.manager [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Detaching volume f8030b13-2139-4764-aa55-b6a7ce2440d5
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:30 user nova-compute[75000]: INFO nova.virt.block_device [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Attempting to driver detach volume f8030b13-2139-4764-aa55-b6a7ce2440d5 from mountpoint /dev/sdc
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Attempting to detach device sdc from instance 5871774d-c8a5-4c72-81b1-d21b632996d3 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:28:30 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:28:30 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:28:30 user nova-compute[75000]:   <target dev="sdc" bus="scsi"/>
Nov 06 22:28:30 user nova-compute[75000]:   <serial>f8030b13-2139-4764-aa55-b6a7ce2440d5</serial>
Nov 06 22:28:30 user nova-compute[75000]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 06 22:28:30 user nova-compute[75000]: </disk>
Nov 06 22:28:30 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:28:30 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Successfully detached device sdc from instance 5871774d-c8a5-4c72-81b1-d21b632996d3 from the persistent domain config.
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5871774d-c8a5-4c72-81b1-d21b632996d3 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:28:30 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:28:30 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:28:30 user nova-compute[75000]:   <target dev="sdc" bus="scsi"/>
Nov 06 22:28:30 user nova-compute[75000]:   <serial>f8030b13-2139-4764-aa55-b6a7ce2440d5</serial>
Nov 06 22:28:30 user nova-compute[75000]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 06 22:28:30 user nova-compute[75000]: </disk>
Nov 06 22:28:30 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (sdc) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.network.neutron [req-bbf1b395-7442-4af0-ab31-b6bd6afc12b0 req-9cd7ac44-2099-495b-a937-1fa2f299dbbb service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bbf1b395-7442-4af0-ab31-b6bd6afc12b0 req-9cd7ac44-2099-495b-a937-1fa2f299dbbb service nova] Releasing lock "refresh_cache-6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquired lock "refresh_cache-6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.network.neutron [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.network.neutron [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:28:30 user nova-compute[75000]: INFO nova.compute.claims [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Claim successful on node user
Nov 06 22:28:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5871774d-c8a5-4c72-81b1-d21b632996d3 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:28:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Updating instance_info_cache with network_info: [{"id": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "address": "fa:16:3e:5f:e6:98", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0e773f-8a", "ovs_interfaceid": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxNcKou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:31 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:31 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:31 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Releasing lock "refresh_cache-6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Instance network_info: |[{"id": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "address": "fa:16:3e:5f:e6:98", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0e773f-8a", "ovs_interfaceid": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Start _get_guest_xml network_info=[{"id": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "address": "fa:16:3e:5f:e6:98", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0e773f-8a", "ovs_interfaceid": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmyEYCha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:31 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:31 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:28:31 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7249MB free_disk=25.33000946044922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2120fb14-f4f9-4cc6-a581-66842efdd5ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:28:31 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:28:31 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1560055579',display_name='tempest-VolumesActionsTest-instance-1560055579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1560055579',id=12,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8f0e789571a4a63b90b26c9a5b0c954',ramdisk_id='',reservation_id='r-23n4opfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-297854992',owner_user_name='tempest-VolumesActionsTest-297854992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:28:28Z,user_data=None,user_id='afc6c795f94d4469825b1ceac5bb2ccb',uuid=6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "address": "fa:16:3e:5f:e6:98", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0e773f-8a", "ovs_interfaceid": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converting VIF {"id": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "address": "fa:16:3e:5f:e6:98", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0e773f-8a", "ovs_interfaceid": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:98,bridge_name='br-int',has_traffic_filtering=True,id=aa0e773f-8a3e-4e26-b935-4e993cbf6c5b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0e773f-8a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.objects.instance [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a955ac-7213-4ff4-b03f-ab974582a324]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2] added
Nov 06 22:28:31 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:28:31 user nova-compute[75000]:   <uuid>6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e</uuid>
Nov 06 22:28:31 user nova-compute[75000]:   <name>instance-0000000c</name>
Nov 06 22:28:31 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:28:31 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:28:31 user nova-compute[75000]:   <metadata>
Nov 06 22:28:31 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:28:31 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:28:31 user nova-compute[75000]:       <nova:name>tempest-VolumesActionsTest-instance-1560055579</nova:name>
Nov 06 22:28:31 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:28:31</nova:creationTime>
Nov 06 22:28:31 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:28:31 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:28:31 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:28:31 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:28:31 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:28:31 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:28:31 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:28:31 user nova-compute[75000]:       <nova:owner>
Nov 06 22:28:31 user nova-compute[75000]:         <nova:user uuid="afc6c795f94d4469825b1ceac5bb2ccb">tempest-VolumesActionsTest-297854992-project-member</nova:user>
Nov 06 22:28:31 user nova-compute[75000]:         <nova:project uuid="a8f0e789571a4a63b90b26c9a5b0c954">tempest-VolumesActionsTest-297854992</nova:project>
Nov 06 22:28:31 user nova-compute[75000]:       </nova:owner>
Nov 06 22:28:31 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:28:31 user nova-compute[75000]:       <nova:ports>
Nov 06 22:28:31 user nova-compute[75000]:         <nova:port uuid="aa0e773f-8a3e-4e26-b935-4e993cbf6c5b">
Nov 06 22:28:31 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:28:31 user nova-compute[75000]:         </nova:port>
Nov 06 22:28:31 user nova-compute[75000]:       </nova:ports>
Nov 06 22:28:31 user nova-compute[75000]:     </nova:instance>
Nov 06 22:28:31 user nova-compute[75000]:   </metadata>
Nov 06 22:28:31 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:28:31 user nova-compute[75000]:     <system>
Nov 06 22:28:31 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:28:31 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:28:31 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:28:31 user nova-compute[75000]:       <entry name="serial">6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e</entry>
Nov 06 22:28:31 user nova-compute[75000]:       <entry name="uuid">6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e</entry>
Nov 06 22:28:31 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:28:31 user nova-compute[75000]:     </system>
Nov 06 22:28:31 user nova-compute[75000]:   </sysinfo>
Nov 06 22:28:31 user nova-compute[75000]:   <os>
Nov 06 22:28:31 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:28:31 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:28:31 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:28:31 user nova-compute[75000]:   </os>
Nov 06 22:28:31 user nova-compute[75000]:   <features>
Nov 06 22:28:31 user nova-compute[75000]:     <acpi/>
Nov 06 22:28:31 user nova-compute[75000]:     <apic/>
Nov 06 22:28:31 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:28:31 user nova-compute[75000]:   </features>
Nov 06 22:28:31 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:28:31 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:28:31 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:28:31 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:28:31 user nova-compute[75000]:   </clock>
Nov 06 22:28:31 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:28:31 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:28:31 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:28:31 user nova-compute[75000]:   </cpu>
Nov 06 22:28:31 user nova-compute[75000]:   <devices>
Nov 06 22:28:31 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:28:31 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:28:31 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk"/>
Nov 06 22:28:31 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:28:31 user nova-compute[75000]:     </disk>
Nov 06 22:28:31 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:28:31 user nova-compute[75000]:       <mac address="fa:16:3e:5f:e6:98"/>
Nov 06 22:28:31 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:28:31 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:28:31 user nova-compute[75000]:       <target dev="tapaa0e773f-8a"/>
Nov 06 22:28:31 user nova-compute[75000]:     </interface>
Nov 06 22:28:31 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:28:31 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/console.log" append="off"/>
Nov 06 22:28:31 user nova-compute[75000]:     </serial>
Nov 06 22:28:31 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:28:31 user nova-compute[75000]:     <video>
Nov 06 22:28:31 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:28:31 user nova-compute[75000]:     </video>
Nov 06 22:28:31 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:28:31 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:28:31 user nova-compute[75000]:     </rng>
Nov 06 22:28:31 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:28:31 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:28:31 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:28:31 user nova-compute[75000]:     </memballoon>
Nov 06 22:28:31 user nova-compute[75000]:   </devices>
Nov 06 22:28:31 user nova-compute[75000]: </domain>
Nov 06 22:28:31 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1560055579',display_name='tempest-VolumesActionsTest-instance-1560055579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1560055579',id=12,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8f0e789571a4a63b90b26c9a5b0c954',ramdisk_id='',reservation_id='r-23n4opfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-297854992',owner_user_name='tempest-VolumesActionsTest-297854992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:28:28Z,user_data=None,user_id='afc6c795f94d4469825b1ceac5bb2ccb',uuid=6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "address": "fa:16:3e:5f:e6:98", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0e773f-8a", "ovs_interfaceid": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converting VIF {"id": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "address": "fa:16:3e:5f:e6:98", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0e773f-8a", "ovs_interfaceid": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:98,bridge_name='br-int',has_traffic_filtering=True,id=aa0e773f-8a3e-4e26-b935-4e993cbf6c5b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0e773f-8a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_vif [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:98,bridge_name='br-int',has_traffic_filtering=True,id=aa0e773f-8a3e-4e26-b935-4e993cbf6c5b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0e773f-8a') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc7c513a-1241-54c7-9306-e7b04a21aae7', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cab586-f14c-40d2-b71c-13400ce38964]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa0e773f-8a, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa0e773f-8a, col_values=(('qos', UUID('eb4eb265-458a-455c-a5f1-1f1d0810623e')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa0e773f-8a, col_values=(('external_ids', {'iface-id': 'aa0e773f-8a3e-4e26-b935-4e993cbf6c5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:e6:98', 'vm-uuid': '6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2d4a3d-91bd-4e63-9046-295bff728cf6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: INFO os_vif [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:98,bridge_name='br-int',has_traffic_filtering=True,id=aa0e773f-8a3e-4e26-b935-4e993cbf6c5b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0e773f-8a')
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztxNcKou {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztxNcKou" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca26659-2227-4640-980f-12e923411664]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztxNcKou'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a35ab7-27a5-480f-b980-7f84b6487171]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] No VIF found with MAC fa:16:3e:5f:e6:98, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[036eb840-bbd8-4141-9268-1c69e4509dbc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:31 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:31 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:31 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:31 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcd3117-e4c3-4ca9-96f7-f8d9271a13b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2, portal: 172.16.0.220,3260]
Nov 06 22:28:31 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2, portal: 172.16.0.220,3260] successful.
Nov 06 22:28:31 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec0462-af53-4e55-a147-f5f26bfe0b3c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.965s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.316s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42ffb47-1000-460c-9195-27e2360a4e06]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:31 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:31 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:31 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:31 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:31 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:31 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e807e912-ad3a-482b-aaa5-bea334867498]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxNcKou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:28:31 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 846bf5e2-230c-419c-be77-982acc036b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance a5f0aa50-4652-4cc3-9e59-899d32567a18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 28799760-9dec-46f7-abf1-03840c3bce4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 5871774d-c8a5-4c72-81b1-d21b632996d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.policy [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddbbf039233142eca9f4cdfe2396da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a8c838f784f309fb9f0066e3463ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:28:31 user nova-compute[75000]: INFO nova.virt.block_device [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Booting with blank volume at /dev/vda
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:28:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.network.neutron [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Successfully created port: 04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23130653139373731', 'path': '/dev/sdd'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130653139373731', 'path': '/dev/sdd'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.397s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:32 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:32 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.objects.instance [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lazy-loading 'flavor' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2649d8-7d5d-4e7b-a621-8cd076bd4fe2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:28:32 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:28:32 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:28:32 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 22:28:32 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:28:32 user nova-compute[75000]:   <serial>4b4cbacf-5614-49b3-858a-b2124aba6ce2</serial>
Nov 06 22:28:32 user nova-compute[75000]: </disk>
Nov 06 22:28:32 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdbd47d-d484-4452-8215-cff3cf04e5d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d] added
Nov 06 22:28:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cce397-144b-4226-b871-39267fd19d38]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f78b3da-eb3f-475d-941c-b6d8fdcb71af]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmyEYCha {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmyEYCha" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4051565-61a8-4040-a1a2-edbc66131be2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wmyEYCha'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba85ac7c-d347-46ca-9985-fa883078c8de]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[629cb870-89c5-4ed3-b311-849725a7006d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.network.neutron [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Successfully updated port: 04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquired lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.network.neutron [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-2a7f8907-ea2e-45c9-8d04-e97e4b46aeab req-28ab72a8-678c-4039-b205-b5b208e0a166 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-changed-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-2a7f8907-ea2e-45c9-8d04-e97e4b46aeab req-28ab72a8-678c-4039-b205-b5b208e0a166 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Refreshing instance network info cache due to event network-changed-04dc5619-eedb-4e04-8f38-cb414d77eb54. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a7f8907-ea2e-45c9-8d04-e97e4b46aeab req-28ab72a8-678c-4039-b205-b5b208e0a166 service nova] Acquiring lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a88460-a55d-4dce-9cdf-8debaa0d7d30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d, portal: 172.16.0.220,3260]
Nov 06 22:28:32 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d, portal: 172.16.0.220,3260] successful.
Nov 06 22:28:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4fd72a-c978-4f0d-9475-5971f75def43]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e37b43-a467-4a70-83dc-fff2b25e0e26]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:32 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-7b9dfa90-9415-4339-a7c6-de55186af7da req-21bbcf9a-468b-4015-929f-08b131137ce7 service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Received event network-vif-plugged-aa0e773f-8a3e-4e26-b935-4e993cbf6c5b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7b9dfa90-9415-4339-a7c6-de55186af7da req-21bbcf9a-468b-4015-929f-08b131137ce7 service nova] Acquiring lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7b9dfa90-9415-4339-a7c6-de55186af7da req-21bbcf9a-468b-4015-929f-08b131137ce7 service nova] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7b9dfa90-9415-4339-a7c6-de55186af7da req-21bbcf9a-468b-4015-929f-08b131137ce7 service nova] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-7b9dfa90-9415-4339-a7c6-de55186af7da req-21bbcf9a-468b-4015-929f-08b131137ce7 service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] No waiting events found dispatching network-vif-plugged-aa0e773f-8a3e-4e26-b935-4e993cbf6c5b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:32 user nova-compute[75000]: WARNING nova.compute.manager [req-7b9dfa90-9415-4339-a7c6-de55186af7da req-21bbcf9a-468b-4015-929f-08b131137ce7 service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Received unexpected event network-vif-plugged-aa0e773f-8a3e-4e26-b935-4e993cbf6c5b for instance with vm_state building and task_state spawning.
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.131s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c2ab50-e867-432b-87d0-54b773bb4d58]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:28:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmyEYCha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.network.neutron [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] No BDM found with device name hda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] No VIF found with MAC fa:16:3e:66:34:1d, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b585341c-a6cf-43a4-ad25-37fd403c97a4 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.067s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.network.neutron [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updating instance_info_cache with network_info: [{"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Releasing lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Instance network_info: |[{"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a7f8907-ea2e-45c9-8d04-e97e4b46aeab req-28ab72a8-678c-4039-b205-b5b208e0a166 service nova] Acquired lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.network.neutron [req-2a7f8907-ea2e-45c9-8d04-e97e4b46aeab req-28ab72a8-678c-4039-b205-b5b208e0a166 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Refreshing network info cache for port 04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.network.neutron [req-2a7f8907-ea2e-45c9-8d04-e97e4b46aeab req-28ab72a8-678c-4039-b205-b5b208e0a166 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updated VIF entry in instance network info cache for port 04dc5619-eedb-4e04-8f38-cb414d77eb54. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.network.neutron [req-2a7f8907-ea2e-45c9-8d04-e97e4b46aeab req-28ab72a8-678c-4039-b205-b5b208e0a166 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updating instance_info_cache with network_info: [{"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a7f8907-ea2e-45c9-8d04-e97e4b46aeab req-28ab72a8-678c-4039-b205-b5b208e0a166 service nova] Releasing lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] <== connect_volume: return (2888ms) {'type': 'block', 'scsi_wwn': '23535626362613437', 'path': '/dev/sde'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535626362613437', 'path': '/dev/sde'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.objects.instance [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lazy-loading 'flavor' on Instance uuid 28799760-9dec-46f7-abf1-03840c3bce4e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] attach device xml: <disk type="block" device="disk">
Nov 06 22:28:33 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:28:33 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:28:33 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:28:33 user nova-compute[75000]:   <serial>5d859962-5ba1-4819-b7f1-167849872a6d</serial>
Nov 06 22:28:33 user nova-compute[75000]: </disk>
Nov 06 22:28:33 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:34 user nova-compute[75000]: INFO nova.compute.manager [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Detaching volume 4b4cbacf-5614-49b3-858a-b2124aba6ce2
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] No VIF found with MAC fa:16:3e:8a:84:1b, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:28:34 user nova-compute[75000]: INFO nova.virt.block_device [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Attempting to driver detach volume 4b4cbacf-5614-49b3-858a-b2124aba6ce2 from mountpoint /dev/vdb
Nov 06 22:28:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Attempting to detach device vdb from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:28:34 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:28:34 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 22:28:34 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:28:34 user nova-compute[75000]:   <serial>4b4cbacf-5614-49b3-858a-b2124aba6ce2</serial>
Nov 06 22:28:34 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 22:28:34 user nova-compute[75000]: </disk>
Nov 06 22:28:34 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:28:34 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Successfully detached device vdb from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 from the persistent domain config.
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:28:34 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:28:34 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 22:28:34 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:28:34 user nova-compute[75000]:   <serial>4b4cbacf-5614-49b3-858a-b2124aba6ce2</serial>
Nov 06 22:28:34 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 22:28:34 user nova-compute[75000]: </disk>
Nov 06 22:28:34 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fef504cf-972b-4760-83ba-10ced700304e tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.469s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-8591a153-15f8-4843-aa5d-efc9b639c6ee req-b7180f93-d7bb-4d91-b59f-2623714cfb07 service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Received event network-vif-plugged-aa0e773f-8a3e-4e26-b935-4e993cbf6c5b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8591a153-15f8-4843-aa5d-efc9b639c6ee req-b7180f93-d7bb-4d91-b59f-2623714cfb07 service nova] Acquiring lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8591a153-15f8-4843-aa5d-efc9b639c6ee req-b7180f93-d7bb-4d91-b59f-2623714cfb07 service nova] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8591a153-15f8-4843-aa5d-efc9b639c6ee req-b7180f93-d7bb-4d91-b59f-2623714cfb07 service nova] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-8591a153-15f8-4843-aa5d-efc9b639c6ee req-b7180f93-d7bb-4d91-b59f-2623714cfb07 service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] No waiting events found dispatching network-vif-plugged-aa0e773f-8a3e-4e26-b935-4e993cbf6c5b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:34 user nova-compute[75000]: WARNING nova.compute.manager [req-8591a153-15f8-4843-aa5d-efc9b639c6ee req-b7180f93-d7bb-4d91-b59f-2623714cfb07 service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Received unexpected event network-vif-plugged-aa0e773f-8a3e-4e26-b935-4e993cbf6c5b for instance with vm_state building and task_state spawning.
Nov 06 22:28:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-abbb9116-0fb8-4825-9dca-018912b453a3 tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] volume_snapshot_create: create_info: {'snapshot_id': '6ae4be08-ac42-4633-aa34-c6241051f2dc', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75000) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-abbb9116-0fb8-4825-9dca-018912b453a3 tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] snap xml: <domainsnapshot>
Nov 06 22:28:35 user nova-compute[75000]:   <disks>
Nov 06 22:28:35 user nova-compute[75000]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 06 22:28:35 user nova-compute[75000]:       <source file="/dev/new_file"/>
Nov 06 22:28:35 user nova-compute[75000]:     </disk>
Nov 06 22:28:35 user nova-compute[75000]:     <disk name="vda" snapshot="no"/>
Nov 06 22:28:35 user nova-compute[75000]:   </disks>
Nov 06 22:28:35 user nova-compute[75000]: </domainsnapshot>
Nov 06 22:28:35 user nova-compute[75000]:  {{(pid=75000) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.objects.instance [None req-abbb9116-0fb8-4825-9dca-018912b453a3 tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] Lazy-loading 'system_metadata' on Instance uuid 28799760-9dec-46f7-abf1-03840c3bce4e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-89fe0911-0d93-4b74-820d-ba952184b44c tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] volume_snapshot_delete: delete_info: {'volume_id': '5d859962-5ba1-4819-b7f1-167849872a6d'} {{(pid=75000) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [None req-89fe0911-0d93-4b74-820d-ba952184b44c tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     if delete_info['type'] != 'qcow2':
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] KeyError: 'type'
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] 
Nov 06 22:28:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-abbb9116-0fb8-4825-9dca-018912b453a3 tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [None req-abbb9116-0fb8-4825-9dca-018912b453a3 tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     rv = execute(f, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     six.reraise(c, e, tb)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     raise value
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     rv = meth(*args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [None req-abbb9116-0fb8-4825-9dca-018912b453a3 tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     self._volume_snapshot_create(context, instance, guest,
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     rv = execute(f, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     six.reraise(c, e, tb)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     raise value
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     rv = meth(*args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [None req-89fe0911-0d93-4b74-820d-ba952184b44c tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-2db0e018-3228-4618-b3ec-5cca89d9af4b)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server [None req-89fe0911-0d93-4b74-820d-ba952184b44c tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] Exception during message handling: KeyError: 'type'
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver [None req-abbb9116-0fb8-4825-9dca-018912b453a3 tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6ae4be08-ac42-4633-aa34-c6241051f2dc could not be found.
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     raise value
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6ae4be08-ac42-4633-aa34-c6241051f2dc could not be found. (HTTP 404) (Request-ID: req-f7beddaa-2fa0-4089-a365-4eedd6b54f0f)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6ae4be08-ac42-4633-aa34-c6241051f2dc could not be found.
Nov 06 22:28:35 user nova-compute[75000]: ERROR nova.virt.libvirt.driver 
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server [None req-abbb9116-0fb8-4825-9dca-018912b453a3 tempest-VolumesAssistedSnapshotsTest-469559905 tempest-VolumesAssistedSnapshotsTest-469559905-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise value
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 22:28:35 user nova-compute[75000]: ERROR oslo_messaging.rpc.server 
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:28:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Instance spawned successfully.
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:28:35 user nova-compute[75000]: INFO nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Took 7.10 seconds to spawn the instance on the hypervisor.
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:35 user nova-compute[75000]: INFO nova.compute.manager [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Detaching volume 5d859962-5ba1-4819-b7f1-167849872a6d
Nov 06 22:28:35 user nova-compute[75000]: INFO nova.compute.manager [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Took 8.43 seconds to build instance.
Nov 06 22:28:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efe2e998-0d1c-4b36-9b87-f170d5b9303f tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.535s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:35 user nova-compute[75000]: INFO nova.virt.block_device [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Attempting to driver detach volume 5d859962-5ba1-4819-b7f1-167849872a6d from mountpoint /dev/vdb
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Attempting to detach device vdb from instance 28799760-9dec-46f7-abf1-03840c3bce4e from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] detach device xml: <disk type="block" device="disk">
Nov 06 22:28:35 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:28:35 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:28:35 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:28:35 user nova-compute[75000]:   <serial>5d859962-5ba1-4819-b7f1-167849872a6d</serial>
Nov 06 22:28:35 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:28:35 user nova-compute[75000]: </disk>
Nov 06 22:28:35 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:28:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Successfully detached device vdb from instance 28799760-9dec-46f7-abf1-03840c3bce4e from the persistent domain config.
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28799760-9dec-46f7-abf1-03840c3bce4e from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] detach device xml: <disk type="block" device="disk">
Nov 06 22:28:35 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:28:35 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:28:35 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:28:35 user nova-compute[75000]:   <serial>5d859962-5ba1-4819-b7f1-167849872a6d</serial>
Nov 06 22:28:35 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:28:35 user nova-compute[75000]: </disk>
Nov 06 22:28:35 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:28:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28799760-9dec-46f7-abf1-03840c3bce4e {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:28:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG os_brick.utils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1472622-87ef-4ae5-a6a0-9936a668a23a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09e7116-4174-490a-838e-e7df840079e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9e182c-6e1a-41e7-b582-09ab48fa029a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecceaec-24fc-4f15-aafc-ebe68ffdc4ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:28:37 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:28:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d24722-7969-47e3-89dc-de1d852cf371]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG os_brick.utils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:37 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updating existing volume attachment record: 7d5f2abc-a101-42cd-ab57-6e9639ed95b4 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:28:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-5292247e-97b2-41bc-9d92-7dd6bc54378d req-080b46af-535c-47f1-9a42-811f85001e59 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-changed-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-5292247e-97b2-41bc-9d92-7dd6bc54378d req-080b46af-535c-47f1-9a42-811f85001e59 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Refreshing instance network info cache due to event network-changed-86811d4a-20c1-4f36-898c-20b19c608073. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:28:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5292247e-97b2-41bc-9d92-7dd6bc54378d req-080b46af-535c-47f1-9a42-811f85001e59 service nova] Acquiring lock "refresh_cache-0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:28:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5292247e-97b2-41bc-9d92-7dd6bc54378d req-080b46af-535c-47f1-9a42-811f85001e59 service nova] Acquired lock "refresh_cache-0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:28:48 user nova-compute[75000]: DEBUG nova.network.neutron [req-5292247e-97b2-41bc-9d92-7dd6bc54378d req-080b46af-535c-47f1-9a42-811f85001e59 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Refreshing network info cache for port 86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:28:49 user nova-compute[75000]: DEBUG nova.network.neutron [req-5292247e-97b2-41bc-9d92-7dd6bc54378d req-080b46af-535c-47f1-9a42-811f85001e59 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Updated VIF entry in instance network info cache for port 86811d4a-20c1-4f36-898c-20b19c608073. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:28:49 user nova-compute[75000]: DEBUG nova.network.neutron [req-5292247e-97b2-41bc-9d92-7dd6bc54378d req-080b46af-535c-47f1-9a42-811f85001e59 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Updating instance_info_cache with network_info: [{"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5292247e-97b2-41bc-9d92-7dd6bc54378d req-080b46af-535c-47f1-9a42-811f85001e59 service nova] Releasing lock "refresh_cache-0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:28:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:49 user nova-compute[75000]: INFO nova.compute.manager [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Rebuilding instance
Nov 06 22:28:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:28:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-3a85b811-de26-4700-bcf7-11d30ac53d48 req-52a57df3-10ae-485b-b121-00a18649e814 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-unplugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3a85b811-de26-4700-bcf7-11d30ac53d48 req-52a57df3-10ae-485b-b121-00a18649e814 service nova] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3a85b811-de26-4700-bcf7-11d30ac53d48 req-52a57df3-10ae-485b-b121-00a18649e814 service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3a85b811-de26-4700-bcf7-11d30ac53d48 req-52a57df3-10ae-485b-b121-00a18649e814 service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-3a85b811-de26-4700-bcf7-11d30ac53d48 req-52a57df3-10ae-485b-b121-00a18649e814 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] No waiting events found dispatching network-vif-unplugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:50 user nova-compute[75000]: WARNING nova.compute.manager [req-3a85b811-de26-4700-bcf7-11d30ac53d48 req-52a57df3-10ae-485b-b121-00a18649e814 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received unexpected event network-vif-unplugged-86811d4a-20c1-4f36-898c-20b19c608073 for instance with vm_state active and task_state rebuilding.
Nov 06 22:28:50 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 5871774d-c8a5-4c72-81b1-d21b632996d3 is timed out.
Nov 06 22:28:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Successfully detached device sdc from instance 5871774d-c8a5-4c72-81b1-d21b632996d3 from the live domain config.
Nov 06 22:28:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KdHOrztZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:50 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adfc43c-7033-4387-be95-8913cf693cf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:28:50 user nova-compute[75000]: No targets found.
Nov 06 22:28:50 user nova-compute[75000]: iSNS:
Nov 06 22:28:50 user nova-compute[75000]: No targets found.
Nov 06 22:28:50 user nova-compute[75000]: STATIC:
Nov 06 22:28:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5
Nov 06 22:28:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2
Nov 06 22:28:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d
Nov 06 22:28:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd
Nov 06 22:28:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:50 user nova-compute[75000]: FIRMWARE:
Nov 06 22:28:50 user nova-compute[75000]: No targets found.
Nov 06 22:28:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:28:50 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:28:50 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance destroyed successfully.
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3a0a1f-4c41-4315-9ca8-6f82dcc193a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance destroyed successfully.
Nov 06 22:28:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1899715161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-974537480',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIby10utLlq64C+H0w0t6/RnIbsoLKrjjLWjuvHWYi0jYgcp6Sn19ciLh/GKqFYOykP4dfqlAYpSrwPN1t6AKylbp6fz517kU3tDTAViFlqnXC1l3fJO2sS1jDfUR8d4fg==',key_name='tempest-keypair-317477647',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9a1f61a8a6d4239ac6c506f63cc68d2',ramdisk_id='',reservation_id='r-l4y2605r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-181120062',owner_user_name='tempest-ServerActionsV293TestJSON-181120062-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f689ecfaa97f410b9ceea5760631957c',uuid=0991271f-2087-4e6a-8fa7-fe29ddfa8ed7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converting VIF {"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_vif [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86811d4a-20, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77a3ad9b-a0fd-4002-bd39-a8be6f824cd5) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d022fd4-ab4c-4bfb-ac2d-b9d16e0fe49c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79fc1d08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:28:50 user nova-compute[75000]: INFO os_vif [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20')
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSODLmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:50 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f12532-bead-4060-9e29-e2190bc16e57]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7273df-d092-4831-9e1c-2f426623b72c]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc316411-fe1e-4a1e-b148-680bf62c9c5a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8960fc-6f79-4f85-861c-96c8f18eb5c8]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0dcaa8-9b88-4185-a4b2-71f962c04707]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd170172-4e11-4c3f-8344-ee57855375c3]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5, portal: 172.16.0.220,3260]
Nov 06 22:28:50 user nova-compute[75000]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5, portal: 172.16.0.220,3260] successful.
Nov 06 22:28:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8030b13-2139-4764-aa55-b6a7ce2440d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de92d733-7997-46ac-bd28-3dcad78a2cf2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] <== disconnect_volume: return (344ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.256s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e647d0f5-39b2-43ba-bb70-39c99634e94f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:28:50 user nova-compute[75000]: No targets found.
Nov 06 22:28:50 user nova-compute[75000]: iSNS:
Nov 06 22:28:50 user nova-compute[75000]: No targets found.
Nov 06 22:28:50 user nova-compute[75000]: STATIC:
Nov 06 22:28:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2
Nov 06 22:28:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d
Nov 06 22:28:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd
Nov 06 22:28:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:50 user nova-compute[75000]: FIRMWARE:
Nov 06 22:28:50 user nova-compute[75000]: No targets found.
Nov 06 22:28:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:28:50 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:28:50 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a317e712-ce45-448a-a4e7-f7b721d733ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1b5db4-d85f-40d5-8338-2cf226d182d9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:50 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc3dd240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:28:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c4321d-e047-4637-aca6-eb8627499add]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72300359-9cfb-4f2f-92bf-49cde131bd76]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[33638bb2-72b4-4f63-8c04-acc9b24112c9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81c564d-7259-4fb9-8971-c44aeda44b22]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa0475f-0763-4f82-a78d-86a61b79d4b8]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[252507b7-88f7-423e-8856-272a5e16ec05]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260]
Nov 06 22:28:51 user nova-compute[75000]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260] successful.
Nov 06 22:28:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0a6cfd-5225-4601-b315-e7b190c1ef79]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] <== disconnect_volume: return (581ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:28:51 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Deleting instance files /opt/stack/data/nova/instances/0991271f-2087-4e6a-8fa7-fe29ddfa8ed7_del
Nov 06 22:28:51 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Deletion of /opt/stack/data/nova/instances/0991271f-2087-4e6a-8fa7-fe29ddfa8ed7_del complete
Nov 06 22:28:51 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 could not be found.
Nov 06 22:28:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSODLmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:51 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec71fc38-7d6d-4db0-be7c-2311d1e78d8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:28:51 user nova-compute[75000]: No targets found.
Nov 06 22:28:51 user nova-compute[75000]: iSNS:
Nov 06 22:28:51 user nova-compute[75000]: No targets found.
Nov 06 22:28:51 user nova-compute[75000]: STATIC:
Nov 06 22:28:51 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2
Nov 06 22:28:51 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:51 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:51 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d
Nov 06 22:28:51 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:51 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:51 user nova-compute[75000]: FIRMWARE:
Nov 06 22:28:51 user nova-compute[75000]: No targets found.
Nov 06 22:28:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:28:51 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:28:51 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f770294a-0285-48ea-b46f-0adefccfeaf4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fe030b-2519-4ee1-8f2a-251073ac7a90]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:51 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:51 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc3df880>, {}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Disconnecting from: [] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] <== disconnect_volume: return (75ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG nova.objects.instance [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lazy-loading 'flavor' on Instance uuid 5871774d-c8a5-4c72-81b1-d21b632996d3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a4d73bd-1cb7-4ead-a969-d4503ce1d8da tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.999s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG nova.compute.manager [req-ba9ed3d8-9cf8-4787-9a2e-6441bf092d46 req-56388509-e789-4500-a5ab-b5f2e6ebccb0 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ba9ed3d8-9cf8-4787-9a2e-6441bf092d46 req-56388509-e789-4500-a5ab-b5f2e6ebccb0 service nova] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ba9ed3d8-9cf8-4787-9a2e-6441bf092d46 req-56388509-e789-4500-a5ab-b5f2e6ebccb0 service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ba9ed3d8-9cf8-4787-9a2e-6441bf092d46 req-56388509-e789-4500-a5ab-b5f2e6ebccb0 service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG nova.compute.manager [req-ba9ed3d8-9cf8-4787-9a2e-6441bf092d46 req-56388509-e789-4500-a5ab-b5f2e6ebccb0 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] No waiting events found dispatching network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:52 user nova-compute[75000]: WARNING nova.compute.manager [req-ba9ed3d8-9cf8-4787-9a2e-6441bf092d46 req-56388509-e789-4500-a5ab-b5f2e6ebccb0 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received unexpected event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 for instance with vm_state active and task_state rebuilding.
Nov 06 22:28:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Preparing to wait for external event volume-reimaged-4c9e9ace-cfb8-4470-ab04-84269ea895dd {{(pid=75000) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:52 user nova-compute[75000]: INFO nova.compute.manager [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Terminating instance
Nov 06 22:28:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-8f6d5004-6ebf-4670-b6fe-61645fab29f7 req-79093945-11b1-4527-9b80-5b97f65bc99e service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received event network-vif-unplugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8f6d5004-6ebf-4670-b6fe-61645fab29f7 req-79093945-11b1-4527-9b80-5b97f65bc99e service nova] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8f6d5004-6ebf-4670-b6fe-61645fab29f7 req-79093945-11b1-4527-9b80-5b97f65bc99e service nova] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8f6d5004-6ebf-4670-b6fe-61645fab29f7 req-79093945-11b1-4527-9b80-5b97f65bc99e service nova] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-8f6d5004-6ebf-4670-b6fe-61645fab29f7 req-79093945-11b1-4527-9b80-5b97f65bc99e service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] No waiting events found dispatching network-vif-unplugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-8f6d5004-6ebf-4670-b6fe-61645fab29f7 req-79093945-11b1-4527-9b80-5b97f65bc99e service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received event network-vif-unplugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Instance destroyed successfully.
Nov 06 22:28:53 user nova-compute[75000]: DEBUG nova.objects.instance [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lazy-loading 'resources' on Instance uuid 5871774d-c8a5-4c72-81b1-d21b632996d3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1043361211',display_name='tempest-AttachSCSIVolumeTestJSON-server-1043361211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1043361211',id=8,image_ref='3e7cc1de-cfa6-46d7-828b-bcad82651f76',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhFzprvja1pQrEugjnx6yCWK9FwQqblBvoEARkZd2entkrXLH9sw3KMmfLvl7XKzYEI9DNWPpaQUjHOqLjZdISjHXl8gL68ALKFBWpFfO9mGXI3EgfrHRZJGNfs0DyjOQ==',key_name='tempest-keypair-1522934550',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b38efffece434857aa9ef955ba548942',ramdisk_id='',reservation_id='r-34tcy7hr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3e7cc1de-cfa6-46d7-828b-bcad82651f76',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-410068501',owner_user_name='tempest-AttachSCSIVolumeTestJSON-410068501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ec398e2e7024fa894e326b719f249e5',uuid=5871774d-c8a5-4c72-81b1-d21b632996d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Converting VIF {"id": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "address": "fa:16:3e:0e:4c:92", "network": {"id": "6441bc90-b900-4807-8011-63a19ccc7c09", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-897196709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b38efffece434857aa9ef955ba548942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6c9e8-3f", "ovs_interfaceid": "a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:4c:92,bridge_name='br-int',has_traffic_filtering=True,id=a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63,network=Network(6441bc90-b900-4807-8011-63a19ccc7c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6c9e8-3f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG os_vif [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:4c:92,bridge_name='br-int',has_traffic_filtering=True,id=a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63,network=Network(6441bc90-b900-4807-8011-63a19ccc7c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6c9e8-3f') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9e6c9e8-3f, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3443b7d5-b0cb-4380-a6e3-769e5e939160) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:53 user nova-compute[75000]: INFO os_vif [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:4c:92,bridge_name='br-int',has_traffic_filtering=True,id=a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63,network=Network(6441bc90-b900-4807-8011-63a19ccc7c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6c9e8-3f')
Nov 06 22:28:53 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Deleting instance files /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3_del
Nov 06 22:28:53 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Deletion of /opt/stack/data/nova/instances/5871774d-c8a5-4c72-81b1-d21b632996d3_del complete
Nov 06 22:28:53 user nova-compute[75000]: INFO nova.compute.manager [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 06 22:28:53 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:28:53 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-3a3aac38-8e39-4da5-a37f-af302c452473 req-0d397215-bba2-4d4d-bf21-93d95304f5e0 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received event network-vif-deleted-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:54 user nova-compute[75000]: INFO nova.compute.manager [req-3a3aac38-8e39-4da5-a37f-af302c452473 req-0d397215-bba2-4d4d-bf21-93d95304f5e0 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Neutron deleted interface a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63; detaching it from the instance and deleting it from the info cache
Nov 06 22:28:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-3a3aac38-8e39-4da5-a37f-af302c452473 req-0d397215-bba2-4d4d-bf21-93d95304f5e0 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:28:54 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Took 0.93 seconds to deallocate network for instance.
Nov 06 22:28:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-3a3aac38-8e39-4da5-a37f-af302c452473 req-0d397215-bba2-4d4d-bf21-93d95304f5e0 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Detach interface failed, port_id=a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63, reason: Instance 5871774d-c8a5-4c72-81b1-d21b632996d3 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:54 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 is timed out.
Nov 06 22:28:54 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Successfully detached device vdb from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 from the live domain config.
Nov 06 22:28:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztxNcKou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:54 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6162fd5b-a673-4338-a55a-45f31669dd0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:28:55 user nova-compute[75000]: No targets found.
Nov 06 22:28:55 user nova-compute[75000]: iSNS:
Nov 06 22:28:55 user nova-compute[75000]: No targets found.
Nov 06 22:28:55 user nova-compute[75000]: STATIC:
Nov 06 22:28:55 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2
Nov 06 22:28:55 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:55 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:55 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d
Nov 06 22:28:55 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:55 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:55 user nova-compute[75000]: FIRMWARE:
Nov 06 22:28:55 user nova-compute[75000]: No targets found.
Nov 06 22:28:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:28:55 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:28:55 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b599666-796b-4b73-bc56-a0c15cdccbf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[308bfa04-585c-4b35-9507-bee12299859f]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:55 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 (non-flash)
Nov 06 22:28:55 user nova-compute[75000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc792290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2'): ({'sdd'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Removing single pathed devices sdd {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[27632602-c466-4cfb-9dbb-374ac1d70812]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc065e4-19e2-48b5-931d-b69ced17f17c]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Flushing IO for device /dev/sdd {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e6f99-ed27-44a7-b494-1d4ea0193c91]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bf0392-d1c6-431d-b26b-c5cf1adb2307]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb8c46e-bf0d-4dfc-81db-a0ef06a85acd]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215edbb-85cf-41e4-9867-a46898b88180]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2, portal: 172.16.0.220,3260]
Nov 06 22:28:55 user nova-compute[75000]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2, portal: 172.16.0.220,3260] successful.
Nov 06 22:28:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b4cbacf-5614-49b3-858a-b2124aba6ce2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b459b0fa-4500-4cc2-a271-d0f5e0af1244]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] <== disconnect_volume: return (336ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-59b1f156-f5f7-4fd1-af46-95e0e8b28cc3 req-7b1d02ae-b66d-4d3f-bad2-51bca74b3874 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received event network-vif-plugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59b1f156-f5f7-4fd1-af46-95e0e8b28cc3 req-7b1d02ae-b66d-4d3f-bad2-51bca74b3874 service nova] Acquiring lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59b1f156-f5f7-4fd1-af46-95e0e8b28cc3 req-7b1d02ae-b66d-4d3f-bad2-51bca74b3874 service nova] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59b1f156-f5f7-4fd1-af46-95e0e8b28cc3 req-7b1d02ae-b66d-4d3f-bad2-51bca74b3874 service nova] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-59b1f156-f5f7-4fd1-af46-95e0e8b28cc3 req-7b1d02ae-b66d-4d3f-bad2-51bca74b3874 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] No waiting events found dispatching network-vif-plugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:55 user nova-compute[75000]: WARNING nova.compute.manager [req-59b1f156-f5f7-4fd1-af46-95e0e8b28cc3 req-7b1d02ae-b66d-4d3f-bad2-51bca74b3874 service nova] [instance: 5871774d-c8a5-4c72-81b1-d21b632996d3] Received unexpected event network-vif-plugged-a9e6c9e8-3f55-41fe-b1f4-cf6d3a5c9e63 for instance with vm_state deleted and task_state None.
Nov 06 22:28:55 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Deleted allocations for instance 5871774d-c8a5-4c72-81b1-d21b632996d3
Nov 06 22:28:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-55e5bd8c-1212-424a-933f-f4fa39e0d5c7 tempest-AttachSCSIVolumeTestJSON-410068501 tempest-AttachSCSIVolumeTestJSON-410068501-project-member] Lock "5871774d-c8a5-4c72-81b1-d21b632996d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.545s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:56 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28799760-9dec-46f7-abf1-03840c3bce4e is timed out.
Nov 06 22:28:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Successfully detached device vdb from instance 28799760-9dec-46f7-abf1-03840c3bce4e from the live domain config.
Nov 06 22:28:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmyEYCha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:28:56 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f25b34-5cf3-4978-a478-64e3b8c6c483]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:28:56 user nova-compute[75000]: No targets found.
Nov 06 22:28:56 user nova-compute[75000]: iSNS:
Nov 06 22:28:56 user nova-compute[75000]: No targets found.
Nov 06 22:28:56 user nova-compute[75000]: STATIC:
Nov 06 22:28:56 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d
Nov 06 22:28:56 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:28:56 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:28:56 user nova-compute[75000]: FIRMWARE:
Nov 06 22:28:56 user nova-compute[75000]: No targets found.
Nov 06 22:28:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:28:56 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:28:56 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[907c9931-9a05-4c92-b103-e84bb52e729e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9467f4-eac6-48e9-8836-dd7ae0500cbc]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d (non-flash)
Nov 06 22:28:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79fc1d0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d'): ({'sde'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Removing single pathed devices sde {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[653315dc-2cb0-4a67-9751-e7693c4a9c0c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1737b4-28c2-4a3c-9761-4247b85128e1]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Flushing IO for device /dev/sde {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5dcd6f-c3d1-40ad-8ff1-132128f23766]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f16fee-a04a-46eb-8368-b416aa09b1ba]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.060s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[978450b6-2534-406b-a1f3-db5fb972e63d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2017a-80a3-4798-a6a8-205345d8b048]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d, portal: 172.16.0.220,3260]
Nov 06 22:28:56 user nova-compute[75000]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d, portal: 172.16.0.220,3260] successful.
Nov 06 22:28:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d859962-5ba1-4819-b7f1-167849872a6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b42ddc-a117-4c5a-b7fe-51b81cdfc480]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] <== disconnect_volume: return (352ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG nova.objects.instance [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lazy-loading 'flavor' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-54b06894-370f-4184-8b65-299b40f91bb0 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.207s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "interface-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-e10592e9-45c1-4af2-a94a-9c7c6895cece" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "interface-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-e10592e9-45c1-4af2-a94a-9c7c6895cece" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lazy-loading 'flavor' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1835765990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1835765990',id=9,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArjEIrT0n0OW5LPmXvMVh9DZ/o4Pi1O5TqTnxckxtr/cvCrVuTzdm4viQKjXknb6ohkpYfDUc8ANMcJJNVXr7cVx4raCgNYYfOxwMtwwTNWKbtPaAVCD3Pym+awkcbDRg==',key_name='tempest-keypair-1428121773',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4353b17e66842a6a1b62609807babb2',ramdisk_id='',reservation_id='r-xypnink8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-22551579',owner_user_name='tempest-TaggedAttachmentsTest-22551579-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce02e55d5db4d6c84b122f1256be658',uuid=5f0350b8-a2c5-49d4-ad89-69e68f8e70d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converting VIF {"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface> {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface> {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Attempting to detach device tape10592e9-45 from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] detach device xml: <interface type="ethernet">
Nov 06 22:28:57 user nova-compute[75000]:   <mac address="fa:16:3e:e7:d9:84"/>
Nov 06 22:28:57 user nova-compute[75000]:   <model type="virtio"/>
Nov 06 22:28:57 user nova-compute[75000]:   <mtu size="1442"/>
Nov 06 22:28:57 user nova-compute[75000]:   <target dev="tape10592e9-45"/>
Nov 06 22:28:57 user nova-compute[75000]: </interface>
Nov 06 22:28:57 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface> {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 06 22:28:57 user nova-compute[75000]:   <name>instance-00000009</name>
Nov 06 22:28:57 user nova-compute[75000]:   <uuid>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</uuid>
Nov 06 22:28:57 user nova-compute[75000]:   <metadata>
Nov 06 22:28:57 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:28:57 user nova-compute[75000]:   <nova:package version="0.0.0"/>
Nov 06 22:28:57 user nova-compute[75000]:   <nova:name>tempest-device-tagging-server-1835765990</nova:name>
Nov 06 22:28:57 user nova-compute[75000]:   <nova:creationTime>2023-11-06 22:28:07</nova:creationTime>
Nov 06 22:28:57 user nova-compute[75000]:   <nova:flavor name="m1.tiny">
Nov 06 22:28:57 user nova-compute[75000]:     <nova:memory>512</nova:memory>
Nov 06 22:28:57 user nova-compute[75000]:     <nova:disk>1</nova:disk>
Nov 06 22:28:57 user nova-compute[75000]:     <nova:swap>0</nova:swap>
Nov 06 22:28:57 user nova-compute[75000]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:28:57 user nova-compute[75000]:     <nova:vcpus>1</nova:vcpus>
Nov 06 22:28:57 user nova-compute[75000]:   </nova:flavor>
Nov 06 22:28:57 user nova-compute[75000]:   <nova:owner>
Nov 06 22:28:57 user nova-compute[75000]:     <nova:user uuid="fce02e55d5db4d6c84b122f1256be658">tempest-TaggedAttachmentsTest-22551579-project-member</nova:user>
Nov 06 22:28:57 user nova-compute[75000]:     <nova:project uuid="c4353b17e66842a6a1b62609807babb2">tempest-TaggedAttachmentsTest-22551579</nova:project>
Nov 06 22:28:57 user nova-compute[75000]:   </nova:owner>
Nov 06 22:28:57 user nova-compute[75000]:   <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:28:57 user nova-compute[75000]:   <nova:ports>
Nov 06 22:28:57 user nova-compute[75000]:     <nova:port uuid="2ca0b032-bdbe-441d-a684-454799aa6fbe">
Nov 06 22:28:57 user nova-compute[75000]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:28:57 user nova-compute[75000]:     </nova:port>
Nov 06 22:28:57 user nova-compute[75000]:     <nova:port uuid="e10592e9-45c1-4af2-a94a-9c7c6895cece">
Nov 06 22:28:57 user nova-compute[75000]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 06 22:28:57 user nova-compute[75000]:     </nova:port>
Nov 06 22:28:57 user nova-compute[75000]:   </nova:ports>
Nov 06 22:28:57 user nova-compute[75000]: </nova:instance>
Nov 06 22:28:57 user nova-compute[75000]:   </metadata>
Nov 06 22:28:57 user nova-compute[75000]:   <memory unit='KiB'>524288</memory>
Nov 06 22:28:57 user nova-compute[75000]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 22:28:57 user nova-compute[75000]:   <vcpu placement='static'>1</vcpu>
Nov 06 22:28:57 user nova-compute[75000]:   <resource>
Nov 06 22:28:57 user nova-compute[75000]:     <partition>/machine</partition>
Nov 06 22:28:57 user nova-compute[75000]:   </resource>
Nov 06 22:28:57 user nova-compute[75000]:   <sysinfo type='smbios'>
Nov 06 22:28:57 user nova-compute[75000]:     <system>
Nov 06 22:28:57 user nova-compute[75000]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 22:28:57 user nova-compute[75000]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 22:28:57 user nova-compute[75000]:       <entry name='version'>0.0.0</entry>
Nov 06 22:28:57 user nova-compute[75000]:       <entry name='serial'>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:28:57 user nova-compute[75000]:       <entry name='uuid'>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:28:57 user nova-compute[75000]:       <entry name='family'>Virtual Machine</entry>
Nov 06 22:28:57 user nova-compute[75000]:     </system>
Nov 06 22:28:57 user nova-compute[75000]:   </sysinfo>
Nov 06 22:28:57 user nova-compute[75000]:   <os>
Nov 06 22:28:57 user nova-compute[75000]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 22:28:57 user nova-compute[75000]:     <boot dev='hd'/>
Nov 06 22:28:57 user nova-compute[75000]:     <smbios mode='sysinfo'/>
Nov 06 22:28:57 user nova-compute[75000]:   </os>
Nov 06 22:28:57 user nova-compute[75000]:   <features>
Nov 06 22:28:57 user nova-compute[75000]:     <acpi/>
Nov 06 22:28:57 user nova-compute[75000]:     <apic/>
Nov 06 22:28:57 user nova-compute[75000]:     <vmcoreinfo state='on'/>
Nov 06 22:28:57 user nova-compute[75000]:   </features>
Nov 06 22:28:57 user nova-compute[75000]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 22:28:57 user nova-compute[75000]:     <model fallback='forbid'>Nehalem</model>
Nov 06 22:28:57 user nova-compute[75000]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 22:28:57 user nova-compute[75000]:     <feature policy='require' name='vme'/>
Nov 06 22:28:57 user nova-compute[75000]:     <feature policy='require' name='x2apic'/>
Nov 06 22:28:57 user nova-compute[75000]:     <feature policy='require' name='hypervisor'/>
Nov 06 22:28:57 user nova-compute[75000]:   </cpu>
Nov 06 22:28:57 user nova-compute[75000]:   <clock offset='utc'>
Nov 06 22:28:57 user nova-compute[75000]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 22:28:57 user nova-compute[75000]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 22:28:57 user nova-compute[75000]:     <timer name='hpet' present='no'/>
Nov 06 22:28:57 user nova-compute[75000]:   </clock>
Nov 06 22:28:57 user nova-compute[75000]:   <on_poweroff>destroy</on_poweroff>
Nov 06 22:28:57 user nova-compute[75000]:   <on_reboot>restart</on_reboot>
Nov 06 22:28:57 user nova-compute[75000]:   <on_crash>destroy</on_crash>
Nov 06 22:28:57 user nova-compute[75000]:   <devices>
Nov 06 22:28:57 user nova-compute[75000]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 22:28:57 user nova-compute[75000]:     <disk type='file' device='disk'>
Nov 06 22:28:57 user nova-compute[75000]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 22:28:57 user nova-compute[75000]:       <source file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk' index='2'/>
Nov 06 22:28:57 user nova-compute[75000]:       <backingStore type='file' index='3'>
Nov 06 22:28:57 user nova-compute[75000]:         <format type='raw'/>
Nov 06 22:28:57 user nova-compute[75000]:         <source file='/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9'/>
Nov 06 22:28:57 user nova-compute[75000]:         <backingStore/>
Nov 06 22:28:57 user nova-compute[75000]:       </backingStore>
Nov 06 22:28:57 user nova-compute[75000]:       <target dev='vda' bus='virtio'/>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='virtio-disk0'/>
Nov 06 22:28:57 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </disk>
Nov 06 22:28:57 user nova-compute[75000]:     <disk type='file' device='cdrom'>
Nov 06 22:28:57 user nova-compute[75000]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 22:28:57 user nova-compute[75000]:       <source file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.config' index='1'/>
Nov 06 22:28:57 user nova-compute[75000]:       <backingStore/>
Nov 06 22:28:57 user nova-compute[75000]:       <target dev='hda' bus='ide'/>
Nov 06 22:28:57 user nova-compute[75000]:       <readonly/>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='ide0-0-0'/>
Nov 06 22:28:57 user nova-compute[75000]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </disk>
Nov 06 22:28:57 user nova-compute[75000]:     <controller type='usb' index='0' model='none'>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='usb'/>
Nov 06 22:28:57 user nova-compute[75000]:     </controller>
Nov 06 22:28:57 user nova-compute[75000]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='pci.0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </controller>
Nov 06 22:28:57 user nova-compute[75000]:     <controller type='ide' index='0'>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='ide'/>
Nov 06 22:28:57 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 22:28:57 user nova-compute[75000]:     </controller>
Nov 06 22:28:57 user nova-compute[75000]:     <interface type='ethernet'>
Nov 06 22:28:57 user nova-compute[75000]:       <mac address='fa:16:3e:66:34:1d'/>
Nov 06 22:28:57 user nova-compute[75000]:       <target dev='tap2ca0b032-bd'/>
Nov 06 22:28:57 user nova-compute[75000]:       <model type='virtio'/>
Nov 06 22:28:57 user nova-compute[75000]:       <mtu size='1442'/>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='net0'/>
Nov 06 22:28:57 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </interface>
Nov 06 22:28:57 user nova-compute[75000]:     <interface type='ethernet'>
Nov 06 22:28:57 user nova-compute[75000]:       <mac address='fa:16:3e:e7:d9:84'/>
Nov 06 22:28:57 user nova-compute[75000]:       <target dev='tape10592e9-45'/>
Nov 06 22:28:57 user nova-compute[75000]:       <model type='virtio'/>
Nov 06 22:28:57 user nova-compute[75000]:       <mtu size='1442'/>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='net1'/>
Nov 06 22:28:57 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </interface>
Nov 06 22:28:57 user nova-compute[75000]:     <serial type='pty'>
Nov 06 22:28:57 user nova-compute[75000]:       <source path='/dev/pts/8'/>
Nov 06 22:28:57 user nova-compute[75000]:       <log file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log' append='off'/>
Nov 06 22:28:57 user nova-compute[75000]:       <target type='isa-serial' port='0'>
Nov 06 22:28:57 user nova-compute[75000]:         <model name='isa-serial'/>
Nov 06 22:28:57 user nova-compute[75000]:       </target>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='serial0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </serial>
Nov 06 22:28:57 user nova-compute[75000]:     <console type='pty' tty='/dev/pts/8'>
Nov 06 22:28:57 user nova-compute[75000]:       <source path='/dev/pts/8'/>
Nov 06 22:28:57 user nova-compute[75000]:       <log file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log' append='off'/>
Nov 06 22:28:57 user nova-compute[75000]:       <target type='serial' port='0'/>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='serial0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </console>
Nov 06 22:28:57 user nova-compute[75000]:     <input type='mouse' bus='ps2'>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='input0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </input>
Nov 06 22:28:57 user nova-compute[75000]:     <input type='keyboard' bus='ps2'>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='input1'/>
Nov 06 22:28:57 user nova-compute[75000]:     </input>
Nov 06 22:28:57 user nova-compute[75000]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 06 22:28:57 user nova-compute[75000]:       <listen type='address' address='0.0.0.0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </graphics>
Nov 06 22:28:57 user nova-compute[75000]:     <audio id='1' type='none'/>
Nov 06 22:28:57 user nova-compute[75000]:     <video>
Nov 06 22:28:57 user nova-compute[75000]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='video0'/>
Nov 06 22:28:57 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </video>
Nov 06 22:28:57 user nova-compute[75000]:     <memballoon model='virtio'>
Nov 06 22:28:57 user nova-compute[75000]:       <stats period='10'/>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='balloon0'/>
Nov 06 22:28:57 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </memballoon>
Nov 06 22:28:57 user nova-compute[75000]:     <rng model='virtio'>
Nov 06 22:28:57 user nova-compute[75000]:       <backend model='random'>/dev/urandom</backend>
Nov 06 22:28:57 user nova-compute[75000]:       <alias name='rng0'/>
Nov 06 22:28:57 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 22:28:57 user nova-compute[75000]:     </rng>
Nov 06 22:28:57 user nova-compute[75000]:   </devices>
Nov 06 22:28:57 user nova-compute[75000]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 22:28:57 user nova-compute[75000]:     <label>libvirt-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</label>
Nov 06 22:28:57 user nova-compute[75000]:     <imagelabel>libvirt-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</imagelabel>
Nov 06 22:28:57 user nova-compute[75000]:   </seclabel>
Nov 06 22:28:57 user nova-compute[75000]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 22:28:57 user nova-compute[75000]:     <label>+64055:+108</label>
Nov 06 22:28:57 user nova-compute[75000]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 22:28:57 user nova-compute[75000]:   </seclabel>
Nov 06 22:28:57 user nova-compute[75000]: </domain>
Nov 06 22:28:57 user nova-compute[75000]:  {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 22:28:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Successfully detached device tape10592e9-45 from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 from the persistent domain config.
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] (1/8): Attempting to detach device tape10592e9-45 with device alias net1 from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] detach device xml: <interface type="ethernet">
Nov 06 22:28:57 user nova-compute[75000]:   <mac address="fa:16:3e:e7:d9:84"/>
Nov 06 22:28:57 user nova-compute[75000]:   <model type="virtio"/>
Nov 06 22:28:57 user nova-compute[75000]:   <mtu size="1442"/>
Nov 06 22:28:57 user nova-compute[75000]:   <target dev="tape10592e9-45"/>
Nov 06 22:28:57 user nova-compute[75000]: </interface>
Nov 06 22:28:57 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lazy-loading 'flavor' on Instance uuid 28799760-9dec-46f7-abf1-03840c3bce4e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-548404ca-ed3b-449c-9b31-e96d31e1b825 tempest-VolumesAssistedSnapshotsTest-1827089085 tempest-VolumesAssistedSnapshotsTest-1827089085-project-admin] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Start waiting for the detach event from libvirt for device tape10592e9-45 with device alias net1 for instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-041f6e96-1de0-42af-8aa3-8a65ea5661b4 req-50985747-6f5e-415f-9d71-011751e90bee service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-unplugged-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-041f6e96-1de0-42af-8aa3-8a65ea5661b4 req-50985747-6f5e-415f-9d71-011751e90bee service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-041f6e96-1de0-42af-8aa3-8a65ea5661b4 req-50985747-6f5e-415f-9d71-011751e90bee service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-041f6e96-1de0-42af-8aa3-8a65ea5661b4 req-50985747-6f5e-415f-9d71-011751e90bee service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-041f6e96-1de0-42af-8aa3-8a65ea5661b4 req-50985747-6f5e-415f-9d71-011751e90bee service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-unplugged-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:57 user nova-compute[75000]: WARNING nova.compute.manager [req-041f6e96-1de0-42af-8aa3-8a65ea5661b4 req-50985747-6f5e-415f-9d71-011751e90bee service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received unexpected event network-vif-unplugged-e10592e9-45c1-4af2-a94a-9c7c6895cece for instance with vm_state active and task_state None.
Nov 06 22:28:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:28:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-c1550824-e9e7-420f-885c-7d63e6975c90 req-84a88880-19b5-4d25-a63e-57118bba8d06 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-plugged-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:28:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c1550824-e9e7-420f-885c-7d63e6975c90 req-84a88880-19b5-4d25-a63e-57118bba8d06 service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:28:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c1550824-e9e7-420f-885c-7d63e6975c90 req-84a88880-19b5-4d25-a63e-57118bba8d06 service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:28:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c1550824-e9e7-420f-885c-7d63e6975c90 req-84a88880-19b5-4d25-a63e-57118bba8d06 service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:28:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-c1550824-e9e7-420f-885c-7d63e6975c90 req-84a88880-19b5-4d25-a63e-57118bba8d06 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-plugged-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:28:59 user nova-compute[75000]: WARNING nova.compute.manager [req-c1550824-e9e7-420f-885c-7d63e6975c90 req-84a88880-19b5-4d25-a63e-57118bba8d06 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received unexpected event network-vif-plugged-e10592e9-45c1-4af2-a94a-9c7c6895cece for instance with vm_state active and task_state None.
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:29:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Creating image(s)
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Ensure instance console log exists: /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Start _get_guest_xml network_info=[{"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNHpGySu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3e6809f-acbd-4763-8d7e-6e748aeab307', 'attached_at': '', 'detached_at': '', 'volume_id': '20156e99-9d0d-4fd7-8b1f-78eb97a74200', 'serial': '20156e99-9d0d-4fd7-8b1f-78eb97a74200'}, 'attachment_id': '7d5f2abc-a101-42cd-ab57-6e9639ed95b4', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:29:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:29:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNHpGySu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:29:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:29:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:29:01 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f34967b-e349-4f9a-a462-31060bd7be48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:29:01 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2152c249-2adf-4dcc-98c7-49f28b052fa6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200] added
Nov 06 22:29:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4809fce9-e4ac-41e5-916f-15cd8cea905c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[367fa329-f537-4e77-bcc3-a7cc8214adb4]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNHpGySu {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNHpGySu" returned: 0 in 0.064s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1b519f-c975-4877-9eb2-783129261822]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNHpGySu'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[caadcdb8-e0e7-4f6c-86ed-1658a4de76ad]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91fc21f-d1df-4711-8eac-e955ec4ddc79]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 22:29:01 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 22:29:01 user nova-compute[75000]:  {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:29:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 22:29:01 user nova-compute[75000]: 
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a367ca-fcd8-4d02-9bda-1a801d665111]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200, portal: 172.16.0.220,3260]
Nov 06 22:29:01 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200, portal: 172.16.0.220,3260] successful.
Nov 06 22:29:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9045bd56-0b9f-4c03-830e-723a57c8289b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0d0ec0-b66a-47fc-8be7-b080dac8d9d9]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[028e2a8a-c8f1-4b63-ac14-5fdb4d830f9d]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNHpGySu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:29:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23265396165666539', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265396165666539', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-487460800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-487460800',id=13,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-yuq7rxnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:28:32Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=d3e6809f-acbd-4763-8d7e-6e748aeab307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7b:51,bridge_name='br-int',has_traffic_filtering=True,id=04dc5619-eedb-4e04-8f38-cb414d77eb54,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc5619-ee') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.objects.instance [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'pci_devices' on Instance uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:29:03 user nova-compute[75000]:   <uuid>d3e6809f-acbd-4763-8d7e-6e748aeab307</uuid>
Nov 06 22:29:03 user nova-compute[75000]:   <name>instance-0000000d</name>
Nov 06 22:29:03 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:29:03 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:29:03 user nova-compute[75000]:   <metadata>
Nov 06 22:29:03 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:29:03 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:29:03 user nova-compute[75000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-487460800</nova:name>
Nov 06 22:29:03 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:29:01</nova:creationTime>
Nov 06 22:29:03 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:29:03 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:29:03 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:29:03 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:29:03 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:29:03 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:29:03 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:29:03 user nova-compute[75000]:       <nova:owner>
Nov 06 22:29:03 user nova-compute[75000]:         <nova:user uuid="ddbbf039233142eca9f4cdfe2396da7c">tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member</nova:user>
Nov 06 22:29:03 user nova-compute[75000]:         <nova:project uuid="3a7a8c838f784f309fb9f0066e3463ae">tempest-ServerBootFromVolumeStableRescueTest-294256413</nova:project>
Nov 06 22:29:03 user nova-compute[75000]:       </nova:owner>
Nov 06 22:29:03 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:29:03 user nova-compute[75000]:       <nova:ports>
Nov 06 22:29:03 user nova-compute[75000]:         <nova:port uuid="04dc5619-eedb-4e04-8f38-cb414d77eb54">
Nov 06 22:29:03 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 06 22:29:03 user nova-compute[75000]:         </nova:port>
Nov 06 22:29:03 user nova-compute[75000]:       </nova:ports>
Nov 06 22:29:03 user nova-compute[75000]:     </nova:instance>
Nov 06 22:29:03 user nova-compute[75000]:   </metadata>
Nov 06 22:29:03 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:29:03 user nova-compute[75000]:     <system>
Nov 06 22:29:03 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:29:03 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:29:03 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:29:03 user nova-compute[75000]:       <entry name="serial">d3e6809f-acbd-4763-8d7e-6e748aeab307</entry>
Nov 06 22:29:03 user nova-compute[75000]:       <entry name="uuid">d3e6809f-acbd-4763-8d7e-6e748aeab307</entry>
Nov 06 22:29:03 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:29:03 user nova-compute[75000]:     </system>
Nov 06 22:29:03 user nova-compute[75000]:   </sysinfo>
Nov 06 22:29:03 user nova-compute[75000]:   <os>
Nov 06 22:29:03 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:29:03 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:29:03 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:29:03 user nova-compute[75000]:   </os>
Nov 06 22:29:03 user nova-compute[75000]:   <features>
Nov 06 22:29:03 user nova-compute[75000]:     <acpi/>
Nov 06 22:29:03 user nova-compute[75000]:     <apic/>
Nov 06 22:29:03 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:29:03 user nova-compute[75000]:   </features>
Nov 06 22:29:03 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:29:03 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:29:03 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:29:03 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:29:03 user nova-compute[75000]:   </clock>
Nov 06 22:29:03 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:29:03 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:29:03 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:29:03 user nova-compute[75000]:   </cpu>
Nov 06 22:29:03 user nova-compute[75000]:   <devices>
Nov 06 22:29:03 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:29:03 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:29:03 user nova-compute[75000]:       <source dev="/dev/sdb"/>
Nov 06 22:29:03 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:29:03 user nova-compute[75000]:       <serial>20156e99-9d0d-4fd7-8b1f-78eb97a74200</serial>
Nov 06 22:29:03 user nova-compute[75000]:     </disk>
Nov 06 22:29:03 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:29:03 user nova-compute[75000]:       <mac address="fa:16:3e:a7:7b:51"/>
Nov 06 22:29:03 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:29:03 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:29:03 user nova-compute[75000]:       <target dev="tap04dc5619-ee"/>
Nov 06 22:29:03 user nova-compute[75000]:     </interface>
Nov 06 22:29:03 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:29:03 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/console.log" append="off"/>
Nov 06 22:29:03 user nova-compute[75000]:     </serial>
Nov 06 22:29:03 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:29:03 user nova-compute[75000]:     <video>
Nov 06 22:29:03 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:29:03 user nova-compute[75000]:     </video>
Nov 06 22:29:03 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:29:03 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:29:03 user nova-compute[75000]:     </rng>
Nov 06 22:29:03 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:29:03 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:29:03 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:29:03 user nova-compute[75000]:     </memballoon>
Nov 06 22:29:03 user nova-compute[75000]:   </devices>
Nov 06 22:29:03 user nova-compute[75000]: </domain>
Nov 06 22:29:03 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-487460800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-487460800',id=13,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-yuq7rxnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:28:32Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=d3e6809f-acbd-4763-8d7e-6e748aeab307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7b:51,bridge_name='br-int',has_traffic_filtering=True,id=04dc5619-eedb-4e04-8f38-cb414d77eb54,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc5619-ee') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG os_vif [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7b:51,bridge_name='br-int',has_traffic_filtering=True,id=04dc5619-eedb-4e04-8f38-cb414d77eb54,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc5619-ee') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbc4f4f7-4faa-582b-8e61-1a3a0485add0', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04dc5619-ee, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04dc5619-ee, col_values=(('qos', UUID('63992f0c-271a-4e1d-a285-375277b98726')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04dc5619-ee, col_values=(('external_ids', {'iface-id': '04dc5619-eedb-4e04-8f38-cb414d77eb54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:7b:51', 'vm-uuid': 'd3e6809f-acbd-4763-8d7e-6e748aeab307'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:03 user nova-compute[75000]: INFO os_vif [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7b:51,bridge_name='br-int',has_traffic_filtering=True,id=04dc5619-eedb-4e04-8f38-cb414d77eb54,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc5619-ee')
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:29:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No VIF found with MAC fa:16:3e:a7:7b:51, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:29:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-444dd601-deb7-466c-b906-abf20ff9b42a req-6eb2a1a7-1fb4-461e-b95e-991ff36c0437 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-444dd601-deb7-466c-b906-abf20ff9b42a req-6eb2a1a7-1fb4-461e-b95e-991ff36c0437 service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-444dd601-deb7-466c-b906-abf20ff9b42a req-6eb2a1a7-1fb4-461e-b95e-991ff36c0437 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-444dd601-deb7-466c-b906-abf20ff9b42a req-6eb2a1a7-1fb4-461e-b95e-991ff36c0437 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-444dd601-deb7-466c-b906-abf20ff9b42a req-6eb2a1a7-1fb4-461e-b95e-991ff36c0437 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:04 user nova-compute[75000]: WARNING nova.compute.manager [req-444dd601-deb7-466c-b906-abf20ff9b42a req-6eb2a1a7-1fb4-461e-b95e-991ff36c0437 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state building and task_state spawning.
Nov 06 22:29:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:29:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Instance spawned successfully.
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.compute.manager [req-b1b7079a-079d-4e12-831e-70902914a078 req-51562fc2-ae6d-4e14-9f25-7732d98cc7f7 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b1b7079a-079d-4e12-831e-70902914a078 req-51562fc2-ae6d-4e14-9f25-7732d98cc7f7 service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b1b7079a-079d-4e12-831e-70902914a078 req-51562fc2-ae6d-4e14-9f25-7732d98cc7f7 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b1b7079a-079d-4e12-831e-70902914a078 req-51562fc2-ae6d-4e14-9f25-7732d98cc7f7 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.compute.manager [req-b1b7079a-079d-4e12-831e-70902914a078 req-51562fc2-ae6d-4e14-9f25-7732d98cc7f7 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:06 user nova-compute[75000]: WARNING nova.compute.manager [req-b1b7079a-079d-4e12-831e-70902914a078 req-51562fc2-ae6d-4e14-9f25-7732d98cc7f7 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state building and task_state spawning.
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:06 user nova-compute[75000]: INFO nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 06 22:29:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:29:07 user nova-compute[75000]: INFO nova.compute.manager [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Took 36.68 seconds to build instance.
Nov 06 22:29:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-95df473c-9e42-4772-b8ee-c33793373b67 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.813s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:17 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Waiting for libvirt event about the detach of device tape10592e9-45 with device alias net1 from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 is timed out.
Nov 06 22:29:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface> {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 06 22:29:17 user nova-compute[75000]:   <name>instance-00000009</name>
Nov 06 22:29:17 user nova-compute[75000]:   <uuid>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</uuid>
Nov 06 22:29:17 user nova-compute[75000]:   <metadata>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:29:17 user nova-compute[75000]:   <nova:package version="0.0.0"/>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:name>tempest-device-tagging-server-1835765990</nova:name>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:creationTime>2023-11-06 22:28:07</nova:creationTime>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:flavor name="m1.tiny">
Nov 06 22:29:17 user nova-compute[75000]:     <nova:memory>512</nova:memory>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:disk>1</nova:disk>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:swap>0</nova:swap>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:vcpus>1</nova:vcpus>
Nov 06 22:29:17 user nova-compute[75000]:   </nova:flavor>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:owner>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:user uuid="fce02e55d5db4d6c84b122f1256be658">tempest-TaggedAttachmentsTest-22551579-project-member</nova:user>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:project uuid="c4353b17e66842a6a1b62609807babb2">tempest-TaggedAttachmentsTest-22551579</nova:project>
Nov 06 22:29:17 user nova-compute[75000]:   </nova:owner>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:ports>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:port uuid="2ca0b032-bdbe-441d-a684-454799aa6fbe">
Nov 06 22:29:17 user nova-compute[75000]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:29:17 user nova-compute[75000]:     </nova:port>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:port uuid="e10592e9-45c1-4af2-a94a-9c7c6895cece">
Nov 06 22:29:17 user nova-compute[75000]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Nov 06 22:29:17 user nova-compute[75000]:     </nova:port>
Nov 06 22:29:17 user nova-compute[75000]:   </nova:ports>
Nov 06 22:29:17 user nova-compute[75000]: </nova:instance>
Nov 06 22:29:17 user nova-compute[75000]:   </metadata>
Nov 06 22:29:17 user nova-compute[75000]:   <memory unit='KiB'>524288</memory>
Nov 06 22:29:17 user nova-compute[75000]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 22:29:17 user nova-compute[75000]:   <vcpu placement='static'>1</vcpu>
Nov 06 22:29:17 user nova-compute[75000]:   <resource>
Nov 06 22:29:17 user nova-compute[75000]:     <partition>/machine</partition>
Nov 06 22:29:17 user nova-compute[75000]:   </resource>
Nov 06 22:29:17 user nova-compute[75000]:   <sysinfo type='smbios'>
Nov 06 22:29:17 user nova-compute[75000]:     <system>
Nov 06 22:29:17 user nova-compute[75000]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 22:29:17 user nova-compute[75000]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 22:29:17 user nova-compute[75000]:       <entry name='version'>0.0.0</entry>
Nov 06 22:29:17 user nova-compute[75000]:       <entry name='serial'>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:29:17 user nova-compute[75000]:       <entry name='uuid'>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:29:17 user nova-compute[75000]:       <entry name='family'>Virtual Machine</entry>
Nov 06 22:29:17 user nova-compute[75000]:     </system>
Nov 06 22:29:17 user nova-compute[75000]:   </sysinfo>
Nov 06 22:29:17 user nova-compute[75000]:   <os>
Nov 06 22:29:17 user nova-compute[75000]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 22:29:17 user nova-compute[75000]:     <boot dev='hd'/>
Nov 06 22:29:17 user nova-compute[75000]:     <smbios mode='sysinfo'/>
Nov 06 22:29:17 user nova-compute[75000]:   </os>
Nov 06 22:29:17 user nova-compute[75000]:   <features>
Nov 06 22:29:17 user nova-compute[75000]:     <acpi/>
Nov 06 22:29:17 user nova-compute[75000]:     <apic/>
Nov 06 22:29:17 user nova-compute[75000]:     <vmcoreinfo state='on'/>
Nov 06 22:29:17 user nova-compute[75000]:   </features>
Nov 06 22:29:17 user nova-compute[75000]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 22:29:17 user nova-compute[75000]:     <model fallback='forbid'>Nehalem</model>
Nov 06 22:29:17 user nova-compute[75000]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 22:29:17 user nova-compute[75000]:     <feature policy='require' name='vme'/>
Nov 06 22:29:17 user nova-compute[75000]:     <feature policy='require' name='x2apic'/>
Nov 06 22:29:17 user nova-compute[75000]:     <feature policy='require' name='hypervisor'/>
Nov 06 22:29:17 user nova-compute[75000]:   </cpu>
Nov 06 22:29:17 user nova-compute[75000]:   <clock offset='utc'>
Nov 06 22:29:17 user nova-compute[75000]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 22:29:17 user nova-compute[75000]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 22:29:17 user nova-compute[75000]:     <timer name='hpet' present='no'/>
Nov 06 22:29:17 user nova-compute[75000]:   </clock>
Nov 06 22:29:17 user nova-compute[75000]:   <on_poweroff>destroy</on_poweroff>
Nov 06 22:29:17 user nova-compute[75000]:   <on_reboot>restart</on_reboot>
Nov 06 22:29:17 user nova-compute[75000]:   <on_crash>destroy</on_crash>
Nov 06 22:29:17 user nova-compute[75000]:   <devices>
Nov 06 22:29:17 user nova-compute[75000]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 22:29:17 user nova-compute[75000]:     <disk type='file' device='disk'>
Nov 06 22:29:17 user nova-compute[75000]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 22:29:17 user nova-compute[75000]:       <source file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk' index='2'/>
Nov 06 22:29:17 user nova-compute[75000]:       <backingStore type='file' index='3'>
Nov 06 22:29:17 user nova-compute[75000]:         <format type='raw'/>
Nov 06 22:29:17 user nova-compute[75000]:         <source file='/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9'/>
Nov 06 22:29:17 user nova-compute[75000]:         <backingStore/>
Nov 06 22:29:17 user nova-compute[75000]:       </backingStore>
Nov 06 22:29:17 user nova-compute[75000]:       <target dev='vda' bus='virtio'/>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='virtio-disk0'/>
Nov 06 22:29:17 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </disk>
Nov 06 22:29:17 user nova-compute[75000]:     <disk type='file' device='cdrom'>
Nov 06 22:29:17 user nova-compute[75000]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 22:29:17 user nova-compute[75000]:       <source file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.config' index='1'/>
Nov 06 22:29:17 user nova-compute[75000]:       <backingStore/>
Nov 06 22:29:17 user nova-compute[75000]:       <target dev='hda' bus='ide'/>
Nov 06 22:29:17 user nova-compute[75000]:       <readonly/>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='ide0-0-0'/>
Nov 06 22:29:17 user nova-compute[75000]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </disk>
Nov 06 22:29:17 user nova-compute[75000]:     <controller type='usb' index='0' model='none'>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='usb'/>
Nov 06 22:29:17 user nova-compute[75000]:     </controller>
Nov 06 22:29:17 user nova-compute[75000]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='pci.0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </controller>
Nov 06 22:29:17 user nova-compute[75000]:     <controller type='ide' index='0'>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='ide'/>
Nov 06 22:29:17 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 22:29:17 user nova-compute[75000]:     </controller>
Nov 06 22:29:17 user nova-compute[75000]:     <interface type='ethernet'>
Nov 06 22:29:17 user nova-compute[75000]:       <mac address='fa:16:3e:66:34:1d'/>
Nov 06 22:29:17 user nova-compute[75000]:       <target dev='tap2ca0b032-bd'/>
Nov 06 22:29:17 user nova-compute[75000]:       <model type='virtio'/>
Nov 06 22:29:17 user nova-compute[75000]:       <mtu size='1442'/>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='net0'/>
Nov 06 22:29:17 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </interface>
Nov 06 22:29:17 user nova-compute[75000]:     <serial type='pty'>
Nov 06 22:29:17 user nova-compute[75000]:       <source path='/dev/pts/8'/>
Nov 06 22:29:17 user nova-compute[75000]:       <log file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log' append='off'/>
Nov 06 22:29:17 user nova-compute[75000]:       <target type='isa-serial' port='0'>
Nov 06 22:29:17 user nova-compute[75000]:         <model name='isa-serial'/>
Nov 06 22:29:17 user nova-compute[75000]:       </target>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='serial0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </serial>
Nov 06 22:29:17 user nova-compute[75000]:     <console type='pty' tty='/dev/pts/8'>
Nov 06 22:29:17 user nova-compute[75000]:       <source path='/dev/pts/8'/>
Nov 06 22:29:17 user nova-compute[75000]:       <log file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log' append='off'/>
Nov 06 22:29:17 user nova-compute[75000]:       <target type='serial' port='0'/>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='serial0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </console>
Nov 06 22:29:17 user nova-compute[75000]:     <input type='mouse' bus='ps2'>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='input0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </input>
Nov 06 22:29:17 user nova-compute[75000]:     <input type='keyboard' bus='ps2'>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='input1'/>
Nov 06 22:29:17 user nova-compute[75000]:     </input>
Nov 06 22:29:17 user nova-compute[75000]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 06 22:29:17 user nova-compute[75000]:       <listen type='address' address='0.0.0.0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </graphics>
Nov 06 22:29:17 user nova-compute[75000]:     <audio id='1' type='none'/>
Nov 06 22:29:17 user nova-compute[75000]:     <video>
Nov 06 22:29:17 user nova-compute[75000]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='video0'/>
Nov 06 22:29:17 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </video>
Nov 06 22:29:17 user nova-compute[75000]:     <memballoon model='virtio'>
Nov 06 22:29:17 user nova-compute[75000]:       <stats period='10'/>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='balloon0'/>
Nov 06 22:29:17 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </memballoon>
Nov 06 22:29:17 user nova-compute[75000]:     <rng model='virtio'>
Nov 06 22:29:17 user nova-compute[75000]:       <backend model='random'>/dev/urandom</backend>
Nov 06 22:29:17 user nova-compute[75000]:       <alias name='rng0'/>
Nov 06 22:29:17 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 22:29:17 user nova-compute[75000]:     </rng>
Nov 06 22:29:17 user nova-compute[75000]:   </devices>
Nov 06 22:29:17 user nova-compute[75000]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 22:29:17 user nova-compute[75000]:     <label>libvirt-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</label>
Nov 06 22:29:17 user nova-compute[75000]:     <imagelabel>libvirt-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</imagelabel>
Nov 06 22:29:17 user nova-compute[75000]:   </seclabel>
Nov 06 22:29:17 user nova-compute[75000]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 22:29:17 user nova-compute[75000]:     <label>+64055:+108</label>
Nov 06 22:29:17 user nova-compute[75000]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 22:29:17 user nova-compute[75000]:   </seclabel>
Nov 06 22:29:17 user nova-compute[75000]: </domain>
Nov 06 22:29:17 user nova-compute[75000]:  {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 22:29:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Successfully detached device tape10592e9-45 from instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 from the live domain config.
Nov 06 22:29:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1835765990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1835765990',id=9,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArjEIrT0n0OW5LPmXvMVh9DZ/o4Pi1O5TqTnxckxtr/cvCrVuTzdm4viQKjXknb6ohkpYfDUc8ANMcJJNVXr7cVx4raCgNYYfOxwMtwwTNWKbtPaAVCD3Pym+awkcbDRg==',key_name='tempest-keypair-1428121773',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4353b17e66842a6a1b62609807babb2',ramdisk_id='',reservation_id='r-xypnink8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-22551579',owner_user_name='tempest-TaggedAttachmentsTest-22551579-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce02e55d5db4d6c84b122f1256be658',uuid=5f0350b8-a2c5-49d4-ad89-69e68f8e70d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converting VIF {"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG os_vif [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape10592e9-45, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7aec0123-50b3-48d6-8e90-eab7b6f00822) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:17 user nova-compute[75000]: INFO os_vif [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45')
Nov 06 22:29:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:29:17 user nova-compute[75000]:   <nova:package version="0.0.0"/>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:name>tempest-device-tagging-server-1835765990</nova:name>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:creationTime>2023-11-06 22:29:17</nova:creationTime>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:flavor name="m1.tiny">
Nov 06 22:29:17 user nova-compute[75000]:     <nova:memory>512</nova:memory>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:disk>1</nova:disk>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:swap>0</nova:swap>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:vcpus>1</nova:vcpus>
Nov 06 22:29:17 user nova-compute[75000]:   </nova:flavor>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:owner>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:user uuid="fce02e55d5db4d6c84b122f1256be658">tempest-TaggedAttachmentsTest-22551579-project-member</nova:user>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:project uuid="c4353b17e66842a6a1b62609807babb2">tempest-TaggedAttachmentsTest-22551579</nova:project>
Nov 06 22:29:17 user nova-compute[75000]:   </nova:owner>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:29:17 user nova-compute[75000]:   <nova:ports>
Nov 06 22:29:17 user nova-compute[75000]:     <nova:port uuid="2ca0b032-bdbe-441d-a684-454799aa6fbe">
Nov 06 22:29:17 user nova-compute[75000]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:29:17 user nova-compute[75000]:     </nova:port>
Nov 06 22:29:17 user nova-compute[75000]:   </nova:ports>
Nov 06 22:29:17 user nova-compute[75000]: </nova:instance>
Nov 06 22:29:17 user nova-compute[75000]:  {{(pid=75000) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-deleted-e10592e9-45c1-4af2-a94a-9c7c6895cece {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:18 user nova-compute[75000]: INFO nova.compute.manager [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Neutron deleted interface e10592e9-45c1-4af2-a94a-9c7c6895cece; detaching it from the instance and deleting it from the info cache
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.network.neutron [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updating instance_info_cache with network_info: [{"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquired lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.objects.instance [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] Lazy-loading 'system_metadata' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.objects.instance [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] Lazy-loading 'flavor' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.objects.base [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] Object Instance<5f0350b8-a2c5-49d4-ad89-69e68f8e70d1> lazy-loaded attributes: system_metadata,flavor {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1835765990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1835765990',id=9,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArjEIrT0n0OW5LPmXvMVh9DZ/o4Pi1O5TqTnxckxtr/cvCrVuTzdm4viQKjXknb6ohkpYfDUc8ANMcJJNVXr7cVx4raCgNYYfOxwMtwwTNWKbtPaAVCD3Pym+awkcbDRg==',key_name='tempest-keypair-1428121773',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4353b17e66842a6a1b62609807babb2',ramdisk_id='',reservation_id='r-xypnink8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-22551579',owner_user_name='tempest-TaggedAttachmentsTest-22551579-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce02e55d5db4d6c84b122f1256be658',uuid=5f0350b8-a2c5-49d4-ad89-69e68f8e70d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] Converting VIF {"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface> {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 06 22:29:18 user nova-compute[75000]:   <name>instance-00000009</name>
Nov 06 22:29:18 user nova-compute[75000]:   <uuid>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</uuid>
Nov 06 22:29:18 user nova-compute[75000]:   <metadata>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:29:18 user nova-compute[75000]:   <nova:package version="0.0.0"/>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:name>tempest-device-tagging-server-1835765990</nova:name>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:creationTime>2023-11-06 22:29:17</nova:creationTime>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:flavor name="m1.tiny">
Nov 06 22:29:18 user nova-compute[75000]:     <nova:memory>512</nova:memory>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:disk>1</nova:disk>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:swap>0</nova:swap>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:vcpus>1</nova:vcpus>
Nov 06 22:29:18 user nova-compute[75000]:   </nova:flavor>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:owner>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:user uuid="fce02e55d5db4d6c84b122f1256be658">tempest-TaggedAttachmentsTest-22551579-project-member</nova:user>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:project uuid="c4353b17e66842a6a1b62609807babb2">tempest-TaggedAttachmentsTest-22551579</nova:project>
Nov 06 22:29:18 user nova-compute[75000]:   </nova:owner>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:ports>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:port uuid="2ca0b032-bdbe-441d-a684-454799aa6fbe">
Nov 06 22:29:18 user nova-compute[75000]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:29:18 user nova-compute[75000]:     </nova:port>
Nov 06 22:29:18 user nova-compute[75000]:   </nova:ports>
Nov 06 22:29:18 user nova-compute[75000]: </nova:instance>
Nov 06 22:29:18 user nova-compute[75000]:   </metadata>
Nov 06 22:29:18 user nova-compute[75000]:   <memory unit='KiB'>524288</memory>
Nov 06 22:29:18 user nova-compute[75000]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 22:29:18 user nova-compute[75000]:   <vcpu placement='static'>1</vcpu>
Nov 06 22:29:18 user nova-compute[75000]:   <resource>
Nov 06 22:29:18 user nova-compute[75000]:     <partition>/machine</partition>
Nov 06 22:29:18 user nova-compute[75000]:   </resource>
Nov 06 22:29:18 user nova-compute[75000]:   <sysinfo type='smbios'>
Nov 06 22:29:18 user nova-compute[75000]:     <system>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='version'>0.0.0</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='serial'>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='uuid'>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='family'>Virtual Machine</entry>
Nov 06 22:29:18 user nova-compute[75000]:     </system>
Nov 06 22:29:18 user nova-compute[75000]:   </sysinfo>
Nov 06 22:29:18 user nova-compute[75000]:   <os>
Nov 06 22:29:18 user nova-compute[75000]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 22:29:18 user nova-compute[75000]:     <boot dev='hd'/>
Nov 06 22:29:18 user nova-compute[75000]:     <smbios mode='sysinfo'/>
Nov 06 22:29:18 user nova-compute[75000]:   </os>
Nov 06 22:29:18 user nova-compute[75000]:   <features>
Nov 06 22:29:18 user nova-compute[75000]:     <acpi/>
Nov 06 22:29:18 user nova-compute[75000]:     <apic/>
Nov 06 22:29:18 user nova-compute[75000]:     <vmcoreinfo state='on'/>
Nov 06 22:29:18 user nova-compute[75000]:   </features>
Nov 06 22:29:18 user nova-compute[75000]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 22:29:18 user nova-compute[75000]:     <model fallback='forbid'>Nehalem</model>
Nov 06 22:29:18 user nova-compute[75000]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 22:29:18 user nova-compute[75000]:     <feature policy='require' name='vme'/>
Nov 06 22:29:18 user nova-compute[75000]:     <feature policy='require' name='x2apic'/>
Nov 06 22:29:18 user nova-compute[75000]:     <feature policy='require' name='hypervisor'/>
Nov 06 22:29:18 user nova-compute[75000]:   </cpu>
Nov 06 22:29:18 user nova-compute[75000]:   <clock offset='utc'>
Nov 06 22:29:18 user nova-compute[75000]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 22:29:18 user nova-compute[75000]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 22:29:18 user nova-compute[75000]:     <timer name='hpet' present='no'/>
Nov 06 22:29:18 user nova-compute[75000]:   </clock>
Nov 06 22:29:18 user nova-compute[75000]:   <on_poweroff>destroy</on_poweroff>
Nov 06 22:29:18 user nova-compute[75000]:   <on_reboot>restart</on_reboot>
Nov 06 22:29:18 user nova-compute[75000]:   <on_crash>destroy</on_crash>
Nov 06 22:29:18 user nova-compute[75000]:   <devices>
Nov 06 22:29:18 user nova-compute[75000]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 22:29:18 user nova-compute[75000]:     <disk type='file' device='disk'>
Nov 06 22:29:18 user nova-compute[75000]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 22:29:18 user nova-compute[75000]:       <source file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk' index='2'/>
Nov 06 22:29:18 user nova-compute[75000]:       <backingStore type='file' index='3'>
Nov 06 22:29:18 user nova-compute[75000]:         <format type='raw'/>
Nov 06 22:29:18 user nova-compute[75000]:         <source file='/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9'/>
Nov 06 22:29:18 user nova-compute[75000]:         <backingStore/>
Nov 06 22:29:18 user nova-compute[75000]:       </backingStore>
Nov 06 22:29:18 user nova-compute[75000]:       <target dev='vda' bus='virtio'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='virtio-disk0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </disk>
Nov 06 22:29:18 user nova-compute[75000]:     <disk type='file' device='cdrom'>
Nov 06 22:29:18 user nova-compute[75000]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 22:29:18 user nova-compute[75000]:       <source file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.config' index='1'/>
Nov 06 22:29:18 user nova-compute[75000]:       <backingStore/>
Nov 06 22:29:18 user nova-compute[75000]:       <target dev='hda' bus='ide'/>
Nov 06 22:29:18 user nova-compute[75000]:       <readonly/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='ide0-0-0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </disk>
Nov 06 22:29:18 user nova-compute[75000]:     <controller type='usb' index='0' model='none'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='usb'/>
Nov 06 22:29:18 user nova-compute[75000]:     </controller>
Nov 06 22:29:18 user nova-compute[75000]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='pci.0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </controller>
Nov 06 22:29:18 user nova-compute[75000]:     <controller type='ide' index='0'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='ide'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 22:29:18 user nova-compute[75000]:     </controller>
Nov 06 22:29:18 user nova-compute[75000]:     <interface type='ethernet'>
Nov 06 22:29:18 user nova-compute[75000]:       <mac address='fa:16:3e:66:34:1d'/>
Nov 06 22:29:18 user nova-compute[75000]:       <target dev='tap2ca0b032-bd'/>
Nov 06 22:29:18 user nova-compute[75000]:       <model type='virtio'/>
Nov 06 22:29:18 user nova-compute[75000]:       <mtu size='1442'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='net0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </interface>
Nov 06 22:29:18 user nova-compute[75000]:     <serial type='pty'>
Nov 06 22:29:18 user nova-compute[75000]:       <source path='/dev/pts/8'/>
Nov 06 22:29:18 user nova-compute[75000]:       <log file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log' append='off'/>
Nov 06 22:29:18 user nova-compute[75000]:       <target type='isa-serial' port='0'>
Nov 06 22:29:18 user nova-compute[75000]:         <model name='isa-serial'/>
Nov 06 22:29:18 user nova-compute[75000]:       </target>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='serial0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </serial>
Nov 06 22:29:18 user nova-compute[75000]:     <console type='pty' tty='/dev/pts/8'>
Nov 06 22:29:18 user nova-compute[75000]:       <source path='/dev/pts/8'/>
Nov 06 22:29:18 user nova-compute[75000]:       <log file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log' append='off'/>
Nov 06 22:29:18 user nova-compute[75000]:       <target type='serial' port='0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='serial0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </console>
Nov 06 22:29:18 user nova-compute[75000]:     <input type='mouse' bus='ps2'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='input0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </input>
Nov 06 22:29:18 user nova-compute[75000]:     <input type='keyboard' bus='ps2'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='input1'/>
Nov 06 22:29:18 user nova-compute[75000]:     </input>
Nov 06 22:29:18 user nova-compute[75000]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 06 22:29:18 user nova-compute[75000]:       <listen type='address' address='0.0.0.0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </graphics>
Nov 06 22:29:18 user nova-compute[75000]:     <audio id='1' type='none'/>
Nov 06 22:29:18 user nova-compute[75000]:     <video>
Nov 06 22:29:18 user nova-compute[75000]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='video0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </video>
Nov 06 22:29:18 user nova-compute[75000]:     <memballoon model='virtio'>
Nov 06 22:29:18 user nova-compute[75000]:       <stats period='10'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='balloon0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </memballoon>
Nov 06 22:29:18 user nova-compute[75000]:     <rng model='virtio'>
Nov 06 22:29:18 user nova-compute[75000]:       <backend model='random'>/dev/urandom</backend>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='rng0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </rng>
Nov 06 22:29:18 user nova-compute[75000]:   </devices>
Nov 06 22:29:18 user nova-compute[75000]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 22:29:18 user nova-compute[75000]:     <label>libvirt-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</label>
Nov 06 22:29:18 user nova-compute[75000]:     <imagelabel>libvirt-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</imagelabel>
Nov 06 22:29:18 user nova-compute[75000]:   </seclabel>
Nov 06 22:29:18 user nova-compute[75000]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 22:29:18 user nova-compute[75000]:     <label>+64055:+108</label>
Nov 06 22:29:18 user nova-compute[75000]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 22:29:18 user nova-compute[75000]:   </seclabel>
Nov 06 22:29:18 user nova-compute[75000]: </domain>
Nov 06 22:29:18 user nova-compute[75000]:  {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface> {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e7:d9:84"/><model type="virtio"/><mtu size="1442"/><target dev="tape10592e9-45"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 06 22:29:18 user nova-compute[75000]:   <name>instance-00000009</name>
Nov 06 22:29:18 user nova-compute[75000]:   <uuid>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</uuid>
Nov 06 22:29:18 user nova-compute[75000]:   <metadata>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:29:18 user nova-compute[75000]:   <nova:package version="0.0.0"/>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:name>tempest-device-tagging-server-1835765990</nova:name>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:creationTime>2023-11-06 22:29:17</nova:creationTime>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:flavor name="m1.tiny">
Nov 06 22:29:18 user nova-compute[75000]:     <nova:memory>512</nova:memory>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:disk>1</nova:disk>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:swap>0</nova:swap>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:vcpus>1</nova:vcpus>
Nov 06 22:29:18 user nova-compute[75000]:   </nova:flavor>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:owner>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:user uuid="fce02e55d5db4d6c84b122f1256be658">tempest-TaggedAttachmentsTest-22551579-project-member</nova:user>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:project uuid="c4353b17e66842a6a1b62609807babb2">tempest-TaggedAttachmentsTest-22551579</nova:project>
Nov 06 22:29:18 user nova-compute[75000]:   </nova:owner>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:ports>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:port uuid="2ca0b032-bdbe-441d-a684-454799aa6fbe">
Nov 06 22:29:18 user nova-compute[75000]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:29:18 user nova-compute[75000]:     </nova:port>
Nov 06 22:29:18 user nova-compute[75000]:   </nova:ports>
Nov 06 22:29:18 user nova-compute[75000]: </nova:instance>
Nov 06 22:29:18 user nova-compute[75000]:   </metadata>
Nov 06 22:29:18 user nova-compute[75000]:   <memory unit='KiB'>524288</memory>
Nov 06 22:29:18 user nova-compute[75000]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 22:29:18 user nova-compute[75000]:   <vcpu placement='static'>1</vcpu>
Nov 06 22:29:18 user nova-compute[75000]:   <resource>
Nov 06 22:29:18 user nova-compute[75000]:     <partition>/machine</partition>
Nov 06 22:29:18 user nova-compute[75000]:   </resource>
Nov 06 22:29:18 user nova-compute[75000]:   <sysinfo type='smbios'>
Nov 06 22:29:18 user nova-compute[75000]:     <system>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='version'>0.0.0</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='serial'>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='uuid'>5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</entry>
Nov 06 22:29:18 user nova-compute[75000]:       <entry name='family'>Virtual Machine</entry>
Nov 06 22:29:18 user nova-compute[75000]:     </system>
Nov 06 22:29:18 user nova-compute[75000]:   </sysinfo>
Nov 06 22:29:18 user nova-compute[75000]:   <os>
Nov 06 22:29:18 user nova-compute[75000]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 22:29:18 user nova-compute[75000]:     <boot dev='hd'/>
Nov 06 22:29:18 user nova-compute[75000]:     <smbios mode='sysinfo'/>
Nov 06 22:29:18 user nova-compute[75000]:   </os>
Nov 06 22:29:18 user nova-compute[75000]:   <features>
Nov 06 22:29:18 user nova-compute[75000]:     <acpi/>
Nov 06 22:29:18 user nova-compute[75000]:     <apic/>
Nov 06 22:29:18 user nova-compute[75000]:     <vmcoreinfo state='on'/>
Nov 06 22:29:18 user nova-compute[75000]:   </features>
Nov 06 22:29:18 user nova-compute[75000]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 22:29:18 user nova-compute[75000]:     <model fallback='forbid'>Nehalem</model>
Nov 06 22:29:18 user nova-compute[75000]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 22:29:18 user nova-compute[75000]:     <feature policy='require' name='vme'/>
Nov 06 22:29:18 user nova-compute[75000]:     <feature policy='require' name='x2apic'/>
Nov 06 22:29:18 user nova-compute[75000]:     <feature policy='require' name='hypervisor'/>
Nov 06 22:29:18 user nova-compute[75000]:   </cpu>
Nov 06 22:29:18 user nova-compute[75000]:   <clock offset='utc'>
Nov 06 22:29:18 user nova-compute[75000]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 22:29:18 user nova-compute[75000]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 22:29:18 user nova-compute[75000]:     <timer name='hpet' present='no'/>
Nov 06 22:29:18 user nova-compute[75000]:   </clock>
Nov 06 22:29:18 user nova-compute[75000]:   <on_poweroff>destroy</on_poweroff>
Nov 06 22:29:18 user nova-compute[75000]:   <on_reboot>restart</on_reboot>
Nov 06 22:29:18 user nova-compute[75000]:   <on_crash>destroy</on_crash>
Nov 06 22:29:18 user nova-compute[75000]:   <devices>
Nov 06 22:29:18 user nova-compute[75000]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 22:29:18 user nova-compute[75000]:     <disk type='file' device='disk'>
Nov 06 22:29:18 user nova-compute[75000]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 22:29:18 user nova-compute[75000]:       <source file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk' index='2'/>
Nov 06 22:29:18 user nova-compute[75000]:       <backingStore type='file' index='3'>
Nov 06 22:29:18 user nova-compute[75000]:         <format type='raw'/>
Nov 06 22:29:18 user nova-compute[75000]:         <source file='/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9'/>
Nov 06 22:29:18 user nova-compute[75000]:         <backingStore/>
Nov 06 22:29:18 user nova-compute[75000]:       </backingStore>
Nov 06 22:29:18 user nova-compute[75000]:       <target dev='vda' bus='virtio'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='virtio-disk0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </disk>
Nov 06 22:29:18 user nova-compute[75000]:     <disk type='file' device='cdrom'>
Nov 06 22:29:18 user nova-compute[75000]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 22:29:18 user nova-compute[75000]:       <source file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk.config' index='1'/>
Nov 06 22:29:18 user nova-compute[75000]:       <backingStore/>
Nov 06 22:29:18 user nova-compute[75000]:       <target dev='hda' bus='ide'/>
Nov 06 22:29:18 user nova-compute[75000]:       <readonly/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='ide0-0-0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </disk>
Nov 06 22:29:18 user nova-compute[75000]:     <controller type='usb' index='0' model='none'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='usb'/>
Nov 06 22:29:18 user nova-compute[75000]:     </controller>
Nov 06 22:29:18 user nova-compute[75000]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='pci.0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </controller>
Nov 06 22:29:18 user nova-compute[75000]:     <controller type='ide' index='0'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='ide'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 22:29:18 user nova-compute[75000]:     </controller>
Nov 06 22:29:18 user nova-compute[75000]:     <interface type='ethernet'>
Nov 06 22:29:18 user nova-compute[75000]:       <mac address='fa:16:3e:66:34:1d'/>
Nov 06 22:29:18 user nova-compute[75000]:       <target dev='tap2ca0b032-bd'/>
Nov 06 22:29:18 user nova-compute[75000]:       <model type='virtio'/>
Nov 06 22:29:18 user nova-compute[75000]:       <mtu size='1442'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='net0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </interface>
Nov 06 22:29:18 user nova-compute[75000]:     <serial type='pty'>
Nov 06 22:29:18 user nova-compute[75000]:       <source path='/dev/pts/8'/>
Nov 06 22:29:18 user nova-compute[75000]:       <log file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log' append='off'/>
Nov 06 22:29:18 user nova-compute[75000]:       <target type='isa-serial' port='0'>
Nov 06 22:29:18 user nova-compute[75000]:         <model name='isa-serial'/>
Nov 06 22:29:18 user nova-compute[75000]:       </target>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='serial0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </serial>
Nov 06 22:29:18 user nova-compute[75000]:     <console type='pty' tty='/dev/pts/8'>
Nov 06 22:29:18 user nova-compute[75000]:       <source path='/dev/pts/8'/>
Nov 06 22:29:18 user nova-compute[75000]:       <log file='/opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/console.log' append='off'/>
Nov 06 22:29:18 user nova-compute[75000]:       <target type='serial' port='0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='serial0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </console>
Nov 06 22:29:18 user nova-compute[75000]:     <input type='mouse' bus='ps2'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='input0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </input>
Nov 06 22:29:18 user nova-compute[75000]:     <input type='keyboard' bus='ps2'>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='input1'/>
Nov 06 22:29:18 user nova-compute[75000]:     </input>
Nov 06 22:29:18 user nova-compute[75000]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 06 22:29:18 user nova-compute[75000]:       <listen type='address' address='0.0.0.0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </graphics>
Nov 06 22:29:18 user nova-compute[75000]:     <audio id='1' type='none'/>
Nov 06 22:29:18 user nova-compute[75000]:     <video>
Nov 06 22:29:18 user nova-compute[75000]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='video0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </video>
Nov 06 22:29:18 user nova-compute[75000]:     <memballoon model='virtio'>
Nov 06 22:29:18 user nova-compute[75000]:       <stats period='10'/>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='balloon0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </memballoon>
Nov 06 22:29:18 user nova-compute[75000]:     <rng model='virtio'>
Nov 06 22:29:18 user nova-compute[75000]:       <backend model='random'>/dev/urandom</backend>
Nov 06 22:29:18 user nova-compute[75000]:       <alias name='rng0'/>
Nov 06 22:29:18 user nova-compute[75000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 22:29:18 user nova-compute[75000]:     </rng>
Nov 06 22:29:18 user nova-compute[75000]:   </devices>
Nov 06 22:29:18 user nova-compute[75000]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 22:29:18 user nova-compute[75000]:     <label>libvirt-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</label>
Nov 06 22:29:18 user nova-compute[75000]:     <imagelabel>libvirt-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1</imagelabel>
Nov 06 22:29:18 user nova-compute[75000]:   </seclabel>
Nov 06 22:29:18 user nova-compute[75000]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 22:29:18 user nova-compute[75000]:     <label>+64055:+108</label>
Nov 06 22:29:18 user nova-compute[75000]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 22:29:18 user nova-compute[75000]:   </seclabel>
Nov 06 22:29:18 user nova-compute[75000]: </domain>
Nov 06 22:29:18 user nova-compute[75000]:  {{(pid=75000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 22:29:18 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Detaching interface fa:16:3e:e7:d9:84 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tape10592e9-45' not found.
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1835765990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1835765990',id=9,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArjEIrT0n0OW5LPmXvMVh9DZ/o4Pi1O5TqTnxckxtr/cvCrVuTzdm4viQKjXknb6ohkpYfDUc8ANMcJJNVXr7cVx4raCgNYYfOxwMtwwTNWKbtPaAVCD3Pym+awkcbDRg==',key_name='tempest-keypair-1428121773',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4353b17e66842a6a1b62609807babb2',ramdisk_id='',reservation_id='r-xypnink8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-22551579',owner_user_name='tempest-TaggedAttachmentsTest-22551579-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce02e55d5db4d6c84b122f1256be658',uuid=5f0350b8-a2c5-49d4-ad89-69e68f8e70d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] Converting VIF {"id": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "address": "fa:16:3e:e7:d9:84", "network": {"id": "08c148af-04db-45ef-ba3a-f81f9d2c5449", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-307154376", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape10592e9-45", "ovs_interfaceid": "e10592e9-45c1-4af2-a94a-9c7c6895cece", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG os_vif [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape10592e9-45, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:29:18 user nova-compute[75000]: INFO os_vif [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d9:84,bridge_name='br-int',has_traffic_filtering=True,id=e10592e9-45c1-4af2-a94a-9c7c6895cece,network=Network(08c148af-04db-45ef-ba3a-f81f9d2c5449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape10592e9-45')
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [req-1a58e291-d1c9-4606-bab3-9d0ad4f99b53 req-dbc07c0d-06cc-4dc9-b404-4a1571c6e3a7 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:29:18 user nova-compute[75000]:   <nova:package version="0.0.0"/>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:name>tempest-device-tagging-server-1835765990</nova:name>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:creationTime>2023-11-06 22:29:18</nova:creationTime>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:flavor name="m1.tiny">
Nov 06 22:29:18 user nova-compute[75000]:     <nova:memory>512</nova:memory>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:disk>1</nova:disk>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:swap>0</nova:swap>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:vcpus>1</nova:vcpus>
Nov 06 22:29:18 user nova-compute[75000]:   </nova:flavor>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:owner>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:user uuid="fce02e55d5db4d6c84b122f1256be658">tempest-TaggedAttachmentsTest-22551579-project-member</nova:user>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:project uuid="c4353b17e66842a6a1b62609807babb2">tempest-TaggedAttachmentsTest-22551579</nova:project>
Nov 06 22:29:18 user nova-compute[75000]:   </nova:owner>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:29:18 user nova-compute[75000]:   <nova:ports>
Nov 06 22:29:18 user nova-compute[75000]:     <nova:port uuid="2ca0b032-bdbe-441d-a684-454799aa6fbe">
Nov 06 22:29:18 user nova-compute[75000]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:29:18 user nova-compute[75000]:     </nova:port>
Nov 06 22:29:18 user nova-compute[75000]:   </nova:ports>
Nov 06 22:29:18 user nova-compute[75000]: </nova:instance>
Nov 06 22:29:18 user nova-compute[75000]:  {{(pid=75000) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 22:29:18 user nova-compute[75000]: INFO nova.network.neutron [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Port e10592e9-45c1-4af2-a94a-9c7c6895cece from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 06 22:29:18 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updating instance_info_cache with network_info: [{"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Releasing lock "refresh_cache-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:29:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ccf3a5c2-34d4-48c5-a7c3-870f387142ec tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "interface-5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-e10592e9-45c1-4af2-a94a-9c7c6895cece" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.448s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:29:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:29:23 user nova-compute[75000]: INFO nova.compute.claims [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Claim successful on node user
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:29:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:29:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG nova.policy [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6b8ec49509748aab2ab06755faf2a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931a6fc1f8a405f83293c6685dc016e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:29:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Creating image(s)
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk 1073741824" returned: 0 in 0.099s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Successfully created port: 884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Cannot resize image /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Ensure instance console log exists: /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updating instance_info_cache with network_info: [{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:29:25 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 req-bd7a5050-70bb-4b07-8a3f-a9e0458c0e3b service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event volume-reimaged-4c9e9ace-cfb8-4470-ab04-84269ea895dd {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 req-bd7a5050-70bb-4b07-8a3f-a9e0458c0e3b service nova] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 req-bd7a5050-70bb-4b07-8a3f-a9e0458c0e3b service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 req-bd7a5050-70bb-4b07-8a3f-a9e0458c0e3b service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 req-bd7a5050-70bb-4b07-8a3f-a9e0458c0e3b service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Processing event volume-reimaged-4c9e9ace-cfb8-4470-ab04-84269ea895dd {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance event wait completed in 33 seconds for volume-reimaged {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:29:26 user nova-compute[75000]: INFO nova.virt.block_device [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Booting with volume 4c9e9ace-cfb8-4470-ab04-84269ea895dd at /dev/vda
Nov 06 22:29:26 user nova-compute[75000]: DEBUG os_brick.utils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Successfully updated port: 884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[67238152-a627-4280-9dbd-b68bf58579c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "refresh_cache-4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquired lock "refresh_cache-4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[415924d1-9968-4dc7-8c73-16f9fa915c0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-34463013-a777-46e0-b1bd-a192141755b8 req-85fdad96-614d-4d0f-913f-a86a52509242 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-changed-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-34463013-a777-46e0-b1bd-a192141755b8 req-85fdad96-614d-4d0f-913f-a86a52509242 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Refreshing instance network info cache due to event network-changed-884e3b6b-4f31-4776-9d5c-b8f64388f438. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-34463013-a777-46e0-b1bd-a192141755b8 req-85fdad96-614d-4d0f-913f-a86a52509242 service nova] Acquiring lock "refresh_cache-4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d56e9f-4461-4563-9e2e-f70bd8230c39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4bd5e8-a91f-430d-9fb0-aaaea55effa7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:29:26 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7d704b-8000-4749-88ae-0a443cc4f097]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG os_brick.utils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Updating existing volume attachment record: 42fc0a3d-f830-4953-83eb-2b00631b50c9 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Updating instance_info_cache with network_info: [{"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Releasing lock "refresh_cache-4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Instance network_info: |[{"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-34463013-a777-46e0-b1bd-a192141755b8 req-85fdad96-614d-4d0f-913f-a86a52509242 service nova] Acquired lock "refresh_cache-4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.network.neutron [req-34463013-a777-46e0-b1bd-a192141755b8 req-85fdad96-614d-4d0f-913f-a86a52509242 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Refreshing network info cache for port 884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Start _get_guest_xml network_info=[{"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:29:26 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:29:26 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1543740670',display_name='tempest-tempest.common.compute-instance-1543740670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1543740670',id=14,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmN/VyKWZXuRaaictuLTmDXlTum2xd2CWW45IjcqETXGMmR4MO8Nfu3+mUVy/T9OyJEtn7OQ4adADPNX/Sr89RqeTH93H8uReMub/zXCcqSw9dSeqiAoLDGj3NUacxE7g==',key_name='tempest-keypair-152635658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-q79vaexu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=4367ded2-3cb6-44bc-a4a2-9b0b4bf98108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'pci_devices' on Instance uuid 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:29:26 user nova-compute[75000]:   <uuid>4367ded2-3cb6-44bc-a4a2-9b0b4bf98108</uuid>
Nov 06 22:29:26 user nova-compute[75000]:   <name>instance-0000000e</name>
Nov 06 22:29:26 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:29:26 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:29:26 user nova-compute[75000]:   <metadata>
Nov 06 22:29:26 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:29:26 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:29:26 user nova-compute[75000]:       <nova:name>tempest-tempest.common.compute-instance-1543740670</nova:name>
Nov 06 22:29:26 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:29:26</nova:creationTime>
Nov 06 22:29:26 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:29:26 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:29:26 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:29:26 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:29:26 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:29:26 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:29:26 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:29:26 user nova-compute[75000]:       <nova:owner>
Nov 06 22:29:26 user nova-compute[75000]:         <nova:user uuid="c6b8ec49509748aab2ab06755faf2a2d">tempest-ServerActionsTestOtherA-287714099-project-member</nova:user>
Nov 06 22:29:26 user nova-compute[75000]:         <nova:project uuid="c931a6fc1f8a405f83293c6685dc016e">tempest-ServerActionsTestOtherA-287714099</nova:project>
Nov 06 22:29:26 user nova-compute[75000]:       </nova:owner>
Nov 06 22:29:26 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:29:26 user nova-compute[75000]:       <nova:ports>
Nov 06 22:29:26 user nova-compute[75000]:         <nova:port uuid="884e3b6b-4f31-4776-9d5c-b8f64388f438">
Nov 06 22:29:26 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 22:29:26 user nova-compute[75000]:         </nova:port>
Nov 06 22:29:26 user nova-compute[75000]:       </nova:ports>
Nov 06 22:29:26 user nova-compute[75000]:     </nova:instance>
Nov 06 22:29:26 user nova-compute[75000]:   </metadata>
Nov 06 22:29:26 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:29:26 user nova-compute[75000]:     <system>
Nov 06 22:29:26 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:29:26 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:29:26 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:29:26 user nova-compute[75000]:       <entry name="serial">4367ded2-3cb6-44bc-a4a2-9b0b4bf98108</entry>
Nov 06 22:29:26 user nova-compute[75000]:       <entry name="uuid">4367ded2-3cb6-44bc-a4a2-9b0b4bf98108</entry>
Nov 06 22:29:26 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:29:26 user nova-compute[75000]:     </system>
Nov 06 22:29:26 user nova-compute[75000]:   </sysinfo>
Nov 06 22:29:26 user nova-compute[75000]:   <os>
Nov 06 22:29:26 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:29:26 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:29:26 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:29:26 user nova-compute[75000]:   </os>
Nov 06 22:29:26 user nova-compute[75000]:   <features>
Nov 06 22:29:26 user nova-compute[75000]:     <acpi/>
Nov 06 22:29:26 user nova-compute[75000]:     <apic/>
Nov 06 22:29:26 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:29:26 user nova-compute[75000]:   </features>
Nov 06 22:29:26 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:29:26 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:29:26 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:29:26 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:29:26 user nova-compute[75000]:   </clock>
Nov 06 22:29:26 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:29:26 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:29:26 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:29:26 user nova-compute[75000]:   </cpu>
Nov 06 22:29:26 user nova-compute[75000]:   <devices>
Nov 06 22:29:26 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:29:26 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:29:26 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk"/>
Nov 06 22:29:26 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:29:26 user nova-compute[75000]:     </disk>
Nov 06 22:29:26 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:29:26 user nova-compute[75000]:       <mac address="fa:16:3e:c2:66:35"/>
Nov 06 22:29:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:29:26 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:29:26 user nova-compute[75000]:       <target dev="tap884e3b6b-4f"/>
Nov 06 22:29:26 user nova-compute[75000]:     </interface>
Nov 06 22:29:26 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:29:26 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/console.log" append="off"/>
Nov 06 22:29:26 user nova-compute[75000]:     </serial>
Nov 06 22:29:26 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:29:26 user nova-compute[75000]:     <video>
Nov 06 22:29:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:29:26 user nova-compute[75000]:     </video>
Nov 06 22:29:26 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:29:26 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:29:26 user nova-compute[75000]:     </rng>
Nov 06 22:29:26 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:29:26 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:29:26 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:29:26 user nova-compute[75000]:     </memballoon>
Nov 06 22:29:26 user nova-compute[75000]:   </devices>
Nov 06 22:29:26 user nova-compute[75000]: </domain>
Nov 06 22:29:26 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1543740670',display_name='tempest-tempest.common.compute-instance-1543740670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1543740670',id=14,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmN/VyKWZXuRaaictuLTmDXlTum2xd2CWW45IjcqETXGMmR4MO8Nfu3+mUVy/T9OyJEtn7OQ4adADPNX/Sr89RqeTH93H8uReMub/zXCcqSw9dSeqiAoLDGj3NUacxE7g==',key_name='tempest-keypair-152635658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-q79vaexu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=4367ded2-3cb6-44bc-a4a2-9b0b4bf98108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG os_vif [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4297c4cb-1e73-518c-9144-0cba0bb0026f', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap884e3b6b-4f, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap884e3b6b-4f, col_values=(('qos', UUID('2586c870-06c3-4a3f-b95d-a9ce0a479330')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap884e3b6b-4f, col_values=(('external_ids', {'iface-id': '884e3b6b-4f31-4776-9d5c-b8f64388f438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:66:35', 'vm-uuid': '4367ded2-3cb6-44bc-a4a2-9b0b4bf98108'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:26 user nova-compute[75000]: INFO os_vif [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f')
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:29:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No VIF found with MAC fa:16:3e:c2:66:35, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:29:27 user nova-compute[75000]: DEBUG nova.network.neutron [req-34463013-a777-46e0-b1bd-a192141755b8 req-85fdad96-614d-4d0f-913f-a86a52509242 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Updated VIF entry in instance network info cache for port 884e3b6b-4f31-4776-9d5c-b8f64388f438. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:29:27 user nova-compute[75000]: DEBUG nova.network.neutron [req-34463013-a777-46e0-b1bd-a192141755b8 req-85fdad96-614d-4d0f-913f-a86a52509242 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Updating instance_info_cache with network_info: [{"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:29:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-34463013-a777-46e0-b1bd-a192141755b8 req-85fdad96-614d-4d0f-913f-a86a52509242 service nova] Releasing lock "refresh_cache-4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-66486614-f0c6-4447-a615-20d0708f0a10 req-329a023b-75fc-4355-8548-a67346d1e49f service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-66486614-f0c6-4447-a615-20d0708f0a10 req-329a023b-75fc-4355-8548-a67346d1e49f service nova] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-66486614-f0c6-4447-a615-20d0708f0a10 req-329a023b-75fc-4355-8548-a67346d1e49f service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-66486614-f0c6-4447-a615-20d0708f0a10 req-329a023b-75fc-4355-8548-a67346d1e49f service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-66486614-f0c6-4447-a615-20d0708f0a10 req-329a023b-75fc-4355-8548-a67346d1e49f service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] No waiting events found dispatching network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:28 user nova-compute[75000]: WARNING nova.compute.manager [req-66486614-f0c6-4447-a615-20d0708f0a10 req-329a023b-75fc-4355-8548-a67346d1e49f service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received unexpected event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 for instance with vm_state building and task_state spawning.
Nov 06 22:29:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-cc4738d0-5bd2-4cf1-b8bb-da6ce072173b req-eeed131a-2344-40bc-9d0e-ff9af4acce24 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cc4738d0-5bd2-4cf1-b8bb-da6ce072173b req-eeed131a-2344-40bc-9d0e-ff9af4acce24 service nova] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cc4738d0-5bd2-4cf1-b8bb-da6ce072173b req-eeed131a-2344-40bc-9d0e-ff9af4acce24 service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cc4738d0-5bd2-4cf1-b8bb-da6ce072173b req-eeed131a-2344-40bc-9d0e-ff9af4acce24 service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-cc4738d0-5bd2-4cf1-b8bb-da6ce072173b req-eeed131a-2344-40bc-9d0e-ff9af4acce24 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] No waiting events found dispatching network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:30 user nova-compute[75000]: WARNING nova.compute.manager [req-cc4738d0-5bd2-4cf1-b8bb-da6ce072173b req-eeed131a-2344-40bc-9d0e-ff9af4acce24 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received unexpected event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 for instance with vm_state building and task_state spawning.
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.objects.instance [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lazy-loading 'flavor' on Instance uuid 846bf5e2-230c-419c-be77-982acc036b40 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:29:30 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Instance spawned successfully.
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:30 user nova-compute[75000]: INFO nova.compute.manager [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Attaching volume b12a60c7-2bb6-4f35-84f2-a15588cc9e8e to /dev/vdb
Nov 06 22:29:30 user nova-compute[75000]: INFO nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG os_brick.utils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d408f6-1426-45c6-b2c3-cb4469fe3b77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[428072d4-dd11-4901-94ea-60128174db86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65f6531-c380-4d74-9d5e-70f7f51b26cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[82945f0f-63ca-4a5b-9b1a-b7232b94b911]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:30 user nova-compute[75000]: INFO nova.compute.manager [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Took 7.12 seconds to build instance.
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:29:30 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:29:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef89ff-9866-4018-8dba-681fb3dd34b5]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG os_brick.utils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:29:30 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating existing volume attachment record: 4fea847a-5bc9-4289-a2c2-62069979dabc {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c35e98eb-3777-4d8b-8342-8a5e5ec3f29c tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.236s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:36 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:29:36 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7767MB free_disk=25.307510375976562GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 846bf5e2-230c-419c-be77-982acc036b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance a5f0aa50-4652-4cc3-9e59-899d32567a18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 28799760-9dec-46f7-abf1-03840c3bce4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:29:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:38 user nova-compute[75000]: INFO nova.compute.manager [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Terminating instance
Nov 06 22:29:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-8246a3ba-cdc8-4cde-8ff5-8fb7b0650f2d req-f2301536-ee36-4d1c-b8d0-cb90bfd34766 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received event network-vif-unplugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8246a3ba-cdc8-4cde-8ff5-8fb7b0650f2d req-f2301536-ee36-4d1c-b8d0-cb90bfd34766 service nova] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8246a3ba-cdc8-4cde-8ff5-8fb7b0650f2d req-f2301536-ee36-4d1c-b8d0-cb90bfd34766 service nova] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8246a3ba-cdc8-4cde-8ff5-8fb7b0650f2d req-f2301536-ee36-4d1c-b8d0-cb90bfd34766 service nova] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-8246a3ba-cdc8-4cde-8ff5-8fb7b0650f2d req-f2301536-ee36-4d1c-b8d0-cb90bfd34766 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] No waiting events found dispatching network-vif-unplugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-8246a3ba-cdc8-4cde-8ff5-8fb7b0650f2d req-f2301536-ee36-4d1c-b8d0-cb90bfd34766 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received event network-vif-unplugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:29:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Instance destroyed successfully.
Nov 06 22:29:38 user nova-compute[75000]: DEBUG nova.objects.instance [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lazy-loading 'resources' on Instance uuid 28799760-9dec-46f7-abf1-03840c3bce4e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-142302469',display_name='tempest-VolumesAssistedSnapshotsTest-server-142302469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-142302469',id=10,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb9GABOJ0y7ov2HVoN53RQjY6BJuqwecAmH/yck7fGF7kd06FX0XSCJ3fM5Cri7SrYZTL5wjtMykV8lozKKIcXcx7WFl3EkIa1OOCnozQUYmLNMcN/yFXBZ9SPZkPdLfw==',key_name='tempest-keypair-1025431515',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c5bea61392f4b3ba79cb9bafd265a3a',ramdisk_id='',reservation_id='r-k9vpuhhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1388042654',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1388042654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e064a43b46e473a8f0fc585751c4b60',uuid=28799760-9dec-46f7-abf1-03840c3bce4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Converting VIF {"id": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "address": "fa:16:3e:8a:84:1b", "network": {"id": "56e74bb3-e3e0-4844-af7a-c238228b0fe7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1749749553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c5bea61392f4b3ba79cb9bafd265a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09e1bf50-5a", "ovs_interfaceid": "09e1bf50-5af1-48ea-b894-6e7d59ddfbd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:84:1b,bridge_name='br-int',has_traffic_filtering=True,id=09e1bf50-5af1-48ea-b894-6e7d59ddfbd8,network=Network(56e74bb3-e3e0-4844-af7a-c238228b0fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e1bf50-5a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG os_vif [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:84:1b,bridge_name='br-int',has_traffic_filtering=True,id=09e1bf50-5af1-48ea-b894-6e7d59ddfbd8,network=Network(56e74bb3-e3e0-4844-af7a-c238228b0fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e1bf50-5a') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09e1bf50-5a, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f4cf3d4-5d1b-458d-9f1a-f1c072750108) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:29:39 user nova-compute[75000]: INFO os_vif [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:84:1b,bridge_name='br-int',has_traffic_filtering=True,id=09e1bf50-5af1-48ea-b894-6e7d59ddfbd8,network=Network(56e74bb3-e3e0-4844-af7a-c238228b0fe7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09e1bf50-5a')
Nov 06 22:29:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Deleting instance files /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e_del
Nov 06 22:29:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Deletion of /opt/stack/data/nova/instances/28799760-9dec-46f7-abf1-03840c3bce4e_del complete
Nov 06 22:29:39 user nova-compute[75000]: INFO nova.compute.manager [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 06 22:29:39 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:29:39 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:29:39 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Took 0.84 seconds to deallocate network for instance.
Nov 06 22:29:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-89cb5636-4856-4897-99f3-6632b4a74c1b req-5f5a9384-5dc9-483e-83ff-38f121eb7b34 service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received event network-vif-deleted-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:40 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:29:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e42f6b1-ff23-4374-8f99-8be94af4ee41 req-3f1c34b9-e5f8-4705-b196-c5488edc730e service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received event network-vif-plugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e42f6b1-ff23-4374-8f99-8be94af4ee41 req-3f1c34b9-e5f8-4705-b196-c5488edc730e service nova] Acquiring lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e42f6b1-ff23-4374-8f99-8be94af4ee41 req-3f1c34b9-e5f8-4705-b196-c5488edc730e service nova] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e42f6b1-ff23-4374-8f99-8be94af4ee41 req-3f1c34b9-e5f8-4705-b196-c5488edc730e service nova] Lock "28799760-9dec-46f7-abf1-03840c3bce4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e42f6b1-ff23-4374-8f99-8be94af4ee41 req-3f1c34b9-e5f8-4705-b196-c5488edc730e service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] No waiting events found dispatching network-vif-plugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:40 user nova-compute[75000]: WARNING nova.compute.manager [req-7e42f6b1-ff23-4374-8f99-8be94af4ee41 req-3f1c34b9-e5f8-4705-b196-c5488edc730e service nova] [instance: 28799760-9dec-46f7-abf1-03840c3bce4e] Received unexpected event network-vif-plugged-09e1bf50-5af1-48ea-b894-6e7d59ddfbd8 for instance with vm_state deleted and task_state None.
Nov 06 22:29:40 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:29:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:40 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Deleted allocations for instance 28799760-9dec-46f7-abf1-03840c3bce4e
Nov 06 22:29:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc08-8467-4a18-a922-371daf96904b tempest-VolumesAssistedSnapshotsTest-1388042654 tempest-VolumesAssistedSnapshotsTest-1388042654-project-member] Lock "28799760-9dec-46f7-abf1-03840c3bce4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.608s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:48 user nova-compute[75000]: INFO nova.compute.manager [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Terminating instance
Nov 06 22:29:48 user nova-compute[75000]: DEBUG nova.compute.manager [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-5674b46c-f347-480d-8af6-7de976444e8a req-e1c9b450-45ec-4ce9-bed9-772166f79832 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-unplugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5674b46c-f347-480d-8af6-7de976444e8a req-e1c9b450-45ec-4ce9-bed9-772166f79832 service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5674b46c-f347-480d-8af6-7de976444e8a req-e1c9b450-45ec-4ce9-bed9-772166f79832 service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5674b46c-f347-480d-8af6-7de976444e8a req-e1c9b450-45ec-4ce9-bed9-772166f79832 service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-5674b46c-f347-480d-8af6-7de976444e8a req-e1c9b450-45ec-4ce9-bed9-772166f79832 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-unplugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-5674b46c-f347-480d-8af6-7de976444e8a req-e1c9b450-45ec-4ce9-bed9-772166f79832 service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-unplugged-2ca0b032-bdbe-441d-a684-454799aa6fbe for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Instance destroyed successfully.
Nov 06 22:29:48 user nova-compute[75000]: DEBUG nova.objects.instance [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lazy-loading 'resources' on Instance uuid 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1835765990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1835765990',id=9,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArjEIrT0n0OW5LPmXvMVh9DZ/o4Pi1O5TqTnxckxtr/cvCrVuTzdm4viQKjXknb6ohkpYfDUc8ANMcJJNVXr7cVx4raCgNYYfOxwMtwwTNWKbtPaAVCD3Pym+awkcbDRg==',key_name='tempest-keypair-1428121773',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4353b17e66842a6a1b62609807babb2',ramdisk_id='',reservation_id='r-xypnink8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-22551579',owner_user_name='tempest-TaggedAttachmentsTest-22551579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce02e55d5db4d6c84b122f1256be658',uuid=5f0350b8-a2c5-49d4-ad89-69e68f8e70d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converting VIF {"id": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "address": "fa:16:3e:66:34:1d", "network": {"id": "e4d3ccbc-050f-43f0-845a-b85796b19f88", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-546323376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4353b17e66842a6a1b62609807babb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca0b032-bd", "ovs_interfaceid": "2ca0b032-bdbe-441d-a684-454799aa6fbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=2ca0b032-bdbe-441d-a684-454799aa6fbe,network=Network(e4d3ccbc-050f-43f0-845a-b85796b19f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca0b032-bd') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG os_vif [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=2ca0b032-bdbe-441d-a684-454799aa6fbe,network=Network(e4d3ccbc-050f-43f0-845a-b85796b19f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca0b032-bd') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ca0b032-bd, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f8c8bcb-58eb-4cc0-9ddf-f32da6d9c44a) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:48 user nova-compute[75000]: INFO os_vif [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=2ca0b032-bdbe-441d-a684-454799aa6fbe,network=Network(e4d3ccbc-050f-43f0-845a-b85796b19f88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca0b032-bd')
Nov 06 22:29:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Deleting instance files /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1_del
Nov 06 22:29:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Deletion of /opt/stack/data/nova/instances/5f0350b8-a2c5-49d4-ad89-69e68f8e70d1_del complete
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: INFO nova.compute.manager [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 06 22:29:49 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:49 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:29:50 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Took 0.91 seconds to deallocate network for instance.
Nov 06 22:29:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-7b01f1a8-01a1-45cc-8335-46e2f6208944 req-86f17603-4362-4ca3-8ab0-152a5ad2334a service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-deleted-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:50 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Deleted allocations for instance 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1
Nov 06 22:29:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:50 user nova-compute[75000]: WARNING nova.compute.manager [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received unexpected event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe for instance with vm_state deleted and task_state None.
Nov 06 22:29:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:50 user nova-compute[75000]: WARNING nova.compute.manager [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received unexpected event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe for instance with vm_state deleted and task_state None.
Nov 06 22:29:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] Acquiring lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] No waiting events found dispatching network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:50 user nova-compute[75000]: WARNING nova.compute.manager [req-46303eac-3e9e-463f-9bcf-52ec3cc41c1d req-2f6df0b1-9181-4b74-b855-b5f23f30658f service nova] [instance: 5f0350b8-a2c5-49d4-ad89-69e68f8e70d1] Received unexpected event network-vif-plugged-2ca0b032-bdbe-441d-a684-454799aa6fbe for instance with vm_state deleted and task_state None.
Nov 06 22:29:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-da0ec78f-98b0-4130-9dec-202a06d32df5 tempest-TaggedAttachmentsTest-22551579 tempest-TaggedAttachmentsTest-22551579-project-member] Lock "5f0350b8-a2c5-49d4-ad89-69e68f8e70d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.569s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:29:51 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Creating image(s)
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Ensure instance console log exists: /opt/stack/data/nova/instances/0991271f-2087-4e6a-8fa7-fe29ddfa8ed7/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Start _get_guest_xml network_info=[{"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSODLmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0991271f-2087-4e6a-8fa7-fe29ddfa8ed7', 'attached_at': '', 'detached_at': '', 'volume_id': '4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'serial': '4c9e9ace-cfb8-4470-ab04-84269ea895dd'}, 'attachment_id': '42fc0a3d-f830-4953-83eb-2b00631b50c9', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:29:51 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 22:29:51 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSODLmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:29:51 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:29:51 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:29:51 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ebfd6-1c49-471b-ae44-cc4a81eab1a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:29:51 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b04bb94-4284-4ba6-9d86-428aa1556ae1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd] added
Nov 06 22:29:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc68367-d781-44fc-938f-db2f1f27beb5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72004fd3-1080-4477-b76b-2a3b49edfac0]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSODLmeB {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSODLmeB" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[543fb41d-87d8-4fa1-b08c-12b31d0241cd]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSODLmeB'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c757b801-a9a3-4226-b4eb-0e8656f833e8]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ed1f56-cf73-4615-b5bd-c626941661e0]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94fe972-4dee-488d-9474-3c28f7138bef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260]
Nov 06 22:29:51 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260] successful.
Nov 06 22:29:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aea31e-e03b-48ed-940c-6bde715e158f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbf2a79-12af-478d-bf66-22a6004e4f0f]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:51 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:29:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:51 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:29:51 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a2cdc8-b379-410d-a798-960f3c62ffe4]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:29:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSODLmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23862343431366439', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862343431366439', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1899715161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-974537480',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIby10utLlq64C+H0w0t6/RnIbsoLKrjjLWjuvHWYi0jYgcp6Sn19ciLh/GKqFYOykP4dfqlAYpSrwPN1t6AKylbp6fz517kU3tDTAViFlqnXC1l3fJO2sS1jDfUR8d4fg==',key_name='tempest-keypair-317477647',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9a1f61a8a6d4239ac6c506f63cc68d2',ramdisk_id='',reservation_id='r-l4y2605r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-181120062',owner_user_name='tempest-ServerActionsV293TestJSON-181120062-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f689ecfaa97f410b9ceea5760631957c',uuid=0991271f-2087-4e6a-8fa7-fe29ddfa8ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converting VIF {"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:29:52 user nova-compute[75000]:   <uuid>0991271f-2087-4e6a-8fa7-fe29ddfa8ed7</uuid>
Nov 06 22:29:52 user nova-compute[75000]:   <name>instance-0000000b</name>
Nov 06 22:29:52 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:29:52 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:29:52 user nova-compute[75000]:   <metadata>
Nov 06 22:29:52 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:29:52 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:29:52 user nova-compute[75000]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1899715161</nova:name>
Nov 06 22:29:52 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:29:51</nova:creationTime>
Nov 06 22:29:52 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:29:52 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:29:52 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:29:52 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:29:52 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:29:52 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:29:52 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:29:52 user nova-compute[75000]:       <nova:owner>
Nov 06 22:29:52 user nova-compute[75000]:         <nova:user uuid="f689ecfaa97f410b9ceea5760631957c">tempest-ServerActionsV293TestJSON-181120062-project-member</nova:user>
Nov 06 22:29:52 user nova-compute[75000]:         <nova:project uuid="c9a1f61a8a6d4239ac6c506f63cc68d2">tempest-ServerActionsV293TestJSON-181120062</nova:project>
Nov 06 22:29:52 user nova-compute[75000]:       </nova:owner>
Nov 06 22:29:52 user nova-compute[75000]:       <nova:ports>
Nov 06 22:29:52 user nova-compute[75000]:         <nova:port uuid="86811d4a-20c1-4f36-898c-20b19c608073">
Nov 06 22:29:52 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 22:29:52 user nova-compute[75000]:         </nova:port>
Nov 06 22:29:52 user nova-compute[75000]:       </nova:ports>
Nov 06 22:29:52 user nova-compute[75000]:     </nova:instance>
Nov 06 22:29:52 user nova-compute[75000]:   </metadata>
Nov 06 22:29:52 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:29:52 user nova-compute[75000]:     <system>
Nov 06 22:29:52 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:29:52 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:29:52 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:29:52 user nova-compute[75000]:       <entry name="serial">0991271f-2087-4e6a-8fa7-fe29ddfa8ed7</entry>
Nov 06 22:29:52 user nova-compute[75000]:       <entry name="uuid">0991271f-2087-4e6a-8fa7-fe29ddfa8ed7</entry>
Nov 06 22:29:52 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:29:52 user nova-compute[75000]:     </system>
Nov 06 22:29:52 user nova-compute[75000]:   </sysinfo>
Nov 06 22:29:52 user nova-compute[75000]:   <os>
Nov 06 22:29:52 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:29:52 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:29:52 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:29:52 user nova-compute[75000]:   </os>
Nov 06 22:29:52 user nova-compute[75000]:   <features>
Nov 06 22:29:52 user nova-compute[75000]:     <acpi/>
Nov 06 22:29:52 user nova-compute[75000]:     <apic/>
Nov 06 22:29:52 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:29:52 user nova-compute[75000]:   </features>
Nov 06 22:29:52 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:29:52 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:29:52 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:29:52 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:29:52 user nova-compute[75000]:   </clock>
Nov 06 22:29:52 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:29:52 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:29:52 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:29:52 user nova-compute[75000]:   </cpu>
Nov 06 22:29:52 user nova-compute[75000]:   <devices>
Nov 06 22:29:52 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:29:52 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:29:52 user nova-compute[75000]:       <source dev="/dev/sdc"/>
Nov 06 22:29:52 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:29:52 user nova-compute[75000]:       <serial>4c9e9ace-cfb8-4470-ab04-84269ea895dd</serial>
Nov 06 22:29:52 user nova-compute[75000]:     </disk>
Nov 06 22:29:52 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:29:52 user nova-compute[75000]:       <mac address="fa:16:3e:84:76:b5"/>
Nov 06 22:29:52 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:29:52 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:29:52 user nova-compute[75000]:       <target dev="tap86811d4a-20"/>
Nov 06 22:29:52 user nova-compute[75000]:     </interface>
Nov 06 22:29:52 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:29:52 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/0991271f-2087-4e6a-8fa7-fe29ddfa8ed7/console.log" append="off"/>
Nov 06 22:29:52 user nova-compute[75000]:     </serial>
Nov 06 22:29:52 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:29:52 user nova-compute[75000]:     <video>
Nov 06 22:29:52 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:29:52 user nova-compute[75000]:     </video>
Nov 06 22:29:52 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:29:52 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:29:52 user nova-compute[75000]:     </rng>
Nov 06 22:29:52 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:29:52 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:29:52 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:29:52 user nova-compute[75000]:     </memballoon>
Nov 06 22:29:52 user nova-compute[75000]:   </devices>
Nov 06 22:29:52 user nova-compute[75000]: </domain>
Nov 06 22:29:52 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1899715161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-974537480',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIby10utLlq64C+H0w0t6/RnIbsoLKrjjLWjuvHWYi0jYgcp6Sn19ciLh/GKqFYOykP4dfqlAYpSrwPN1t6AKylbp6fz517kU3tDTAViFlqnXC1l3fJO2sS1jDfUR8d4fg==',key_name='tempest-keypair-317477647',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9a1f61a8a6d4239ac6c506f63cc68d2',ramdisk_id='',reservation_id='r-l4y2605r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-181120062',owner_user_name='tempest-ServerActionsV293TestJSON-181120062-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f689ecfaa97f410b9ceea5760631957c',uuid=0991271f-2087-4e6a-8fa7-fe29ddfa8ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converting VIF {"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG os_vif [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47bae2c7-757b-5bbe-bb78-b9a88e0dbe56', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86811d4a-20, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86811d4a-20, col_values=(('qos', UUID('95ee4cb8-a6d6-418b-89f9-4243fa37ad40')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86811d4a-20, col_values=(('external_ids', {'iface-id': '86811d4a-20c1-4f36-898c-20b19c608073', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:76:b5', 'vm-uuid': '0991271f-2087-4e6a-8fa7-fe29ddfa8ed7'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:52 user nova-compute[75000]: INFO os_vif [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20')
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:29:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] No VIF found with MAC fa:16:3e:84:76:b5, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-34b1ecaf-3885-4ad6-9889-6d2395d1c03e req-6b1c5551-8194-48d1-97c7-b2bdcde6d06b service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-34b1ecaf-3885-4ad6-9889-6d2395d1c03e req-6b1c5551-8194-48d1-97c7-b2bdcde6d06b service nova] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-34b1ecaf-3885-4ad6-9889-6d2395d1c03e req-6b1c5551-8194-48d1-97c7-b2bdcde6d06b service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-34b1ecaf-3885-4ad6-9889-6d2395d1c03e req-6b1c5551-8194-48d1-97c7-b2bdcde6d06b service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-34b1ecaf-3885-4ad6-9889-6d2395d1c03e req-6b1c5551-8194-48d1-97c7-b2bdcde6d06b service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] No waiting events found dispatching network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:54 user nova-compute[75000]: WARNING nova.compute.manager [req-34b1ecaf-3885-4ad6-9889-6d2395d1c03e req-6b1c5551-8194-48d1-97c7-b2bdcde6d06b service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received unexpected event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 for instance with vm_state active and task_state rebuild_spawning.
Nov 06 22:29:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:29:55 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:29:55 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:29:55 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b97b52-9416-46b5-a7e8-5de6c1ac9079]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:29:55 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[314f131d-f9bd-4bfb-8202-b2079caf88ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e] added
Nov 06 22:29:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c16c02-4185-4a53-932a-3dc9dd6bacac]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faebcec-b8f9-4ed7-8e7a-788662d8816c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wopgvcrh {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wopgvcrh" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe850ed-da72-4b4b-8df9-bd11f86233f7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wopgvcrh'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0909d5-a891-471a-b74b-abc59c211b29]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a284b-449b-4a74-a265-00d23e4a4add]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:55 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:29:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:55 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:29:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff807404-9148-486f-8786-fcc7707f9a4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]
Nov 06 22:29:55 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.
Nov 06 22:29:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6513a783-1ee2-4e0f-9569-28cc2ff96037]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[af01a3e5-f2f6-492a-acaf-531538e90c2a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:29:55 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:55 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:29:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:29:55 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:29:55 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:29:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3d0e76-53e8-4dfc-9ca5-b94ab30a549d]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:29:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:29:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance spawned successfully.
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-ce4fdc1b-d38b-4d42-ad13-b74a8c2351fd req-3ff469fd-d1d4-42d8-8005-16bd20ebb257 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce4fdc1b-d38b-4d42-ad13-b74a8c2351fd req-3ff469fd-d1d4-42d8-8005-16bd20ebb257 service nova] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce4fdc1b-d38b-4d42-ad13-b74a8c2351fd req-3ff469fd-d1d4-42d8-8005-16bd20ebb257 service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce4fdc1b-d38b-4d42-ad13-b74a8c2351fd req-3ff469fd-d1d4-42d8-8005-16bd20ebb257 service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-ce4fdc1b-d38b-4d42-ad13-b74a8c2351fd req-3ff469fd-d1d4-42d8-8005-16bd20ebb257 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] No waiting events found dispatching network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:29:56 user nova-compute[75000]: WARNING nova.compute.manager [req-ce4fdc1b-d38b-4d42-ad13-b74a8c2351fd req-3ff469fd-d1d4-42d8-8005-16bd20ebb257 service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received unexpected event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 for instance with vm_state active and task_state rebuild_spawning.
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75000) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23464613137396432', 'path': '/dev/sdd'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464613137396432', 'path': '/dev/sdd'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.objects.instance [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lazy-loading 'flavor' on Instance uuid 846bf5e2-230c-419c-be77-982acc036b40 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0a13cccb-5fe8-4fe4-b54a-09d47d45cc70 tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:29:56 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:29:56 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 22:29:56 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:29:56 user nova-compute[75000]:   <serial>b12a60c7-2bb6-4f35-84f2-a15588cc9e8e</serial>
Nov 06 22:29:56 user nova-compute[75000]: </disk>
Nov 06 22:29:56 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:29:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:29:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:29:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] No VIF found with MAC fa:16:3e:4f:6d:94, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:29:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-29fa742b-5a07-4da1-9200-b0e4b2bdaf26 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.517s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:29:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:29:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:29:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:29:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:29:59 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:29:59 user nova-compute[75000]: INFO nova.compute.claims [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Claim successful on node user
Nov 06 22:30:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Stashing vm_state: active {{(pid=75000) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.178s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:30:00 user nova-compute[75000]: INFO nova.compute.claims [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Claim successful on node user
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:30:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:30:00 user nova-compute[75000]: INFO nova.compute.resource_tracker [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating resource usage from migration de7322ef-e0f7-48fc-be65-bc1fc3f4385c
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.policy [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81298fc90bc8498db1b9a2ecc8d272c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4172b6528d4cb282b1906ef73fadf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:30:00 user nova-compute[75000]: INFO nova.virt.block_device [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Booting with volume 2e1fcc01-a3aa-4896-ba3f-f7509a966569 at /dev/vda
Nov 06 22:30:00 user nova-compute[75000]: DEBUG os_brick.utils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[14047118-0de2-44f0-a89d-4e5201142500]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f151d338-d5ab-4753-bfea-40b8665a6954]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba935022-3882-46a6-974d-c871c7d06117]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26bf902-28f9-496b-8fe4-e7889c193947]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:30:01 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf81ff07-bf6c-48d8-a6a2-e8406e7535db]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG os_brick.utils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating existing volume attachment record: 23b686c9-931a-4c38-852d-93c135d07bb3 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.646s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:01 user nova-compute[75000]: INFO nova.compute.manager [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Migrating
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:01 user nova-compute[75000]: INFO nova.compute.rpcapi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquired lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance_info_cache with network_info: [{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Releasing lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully created port: edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:30:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Starting migrate_disk_and_power_off {{(pid=75000) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-12b45b1c-711d-4a4a-827d-865b9f543979 req-d404ebfa-ec4b-4d34-bce9-42f9e70d5687 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-unplugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-12b45b1c-711d-4a4a-827d-865b9f543979 req-d404ebfa-ec4b-4d34-bce9-42f9e70d5687 service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-12b45b1c-711d-4a4a-827d-865b9f543979 req-d404ebfa-ec4b-4d34-bce9-42f9e70d5687 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-12b45b1c-711d-4a4a-827d-865b9f543979 req-d404ebfa-ec4b-4d34-bce9-42f9e70d5687 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-12b45b1c-711d-4a4a-827d-865b9f543979 req-d404ebfa-ec4b-4d34-bce9-42f9e70d5687 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-unplugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:02 user nova-compute[75000]: WARNING nova.compute.manager [req-12b45b1c-711d-4a4a-827d-865b9f543979 req-d404ebfa-ec4b-4d34-bce9-42f9e70d5687 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-unplugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state active and task_state resize_migrating.
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully created port: 8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:30:02 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance destroyed successfully.
Nov 06 22:30:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-410044661',display_name='tempest-ServerActionsTestOtherB-server-410044661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-410044661',id=6,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN127j9rMCzJhcsyMMnA9oMyDSW626YDveQjSPb2IR7mcffJ8blZhWvgtIPRXJ9KDmmNRktgeSU8SDicFRInDOK2YoxINbUZ+i2iHac2q1b7ra/rMkxI3W72lm49ZRgf7w==',key_name='tempest-keypair-1677332467',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:25:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54eb33cd621c4fa78fead18be74916ee',ramdisk_id='',reservation_id='r-nlmmujhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-408033839',owner_user_name='tempest-ServerActionsTestOtherB-408033839-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8b116c4cb154ce0a1a80045258cd123',uuid=846bf5e2-230c-419c-be77-982acc036b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-651500099-network", "vif_mac": "fa:16:3e:4f:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converting VIF {"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-651500099-network", "vif_mac": "fa:16:3e:4f:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_vif [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6cb1907-7c, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11a6958f-8541-4503-96f7-88282d8a3ecf) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:02 user nova-compute[75000]: INFO os_vif [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c')
Nov 06 22:30:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:30:02 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d92e185-b84c-4a3a-ad67-c55744db9e0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:30:02 user nova-compute[75000]: No targets found.
Nov 06 22:30:02 user nova-compute[75000]: iSNS:
Nov 06 22:30:02 user nova-compute[75000]: No targets found.
Nov 06 22:30:02 user nova-compute[75000]: STATIC:
Nov 06 22:30:02 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:30:02 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:30:02 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:30:02 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:30:02 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:30:02 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:30:02 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd
Nov 06 22:30:02 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:30:02 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:30:02 user nova-compute[75000]: FIRMWARE:
Nov 06 22:30:02 user nova-compute[75000]: No targets found.
Nov 06 22:30:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:30:02 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:30:02 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9565d95-21ba-4fc2-8df6-134a4a11ddd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb83dcf-8afb-45fe-900d-58ac47f71e81]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:30:02 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:30:02 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:30:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:30:02 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:30:02 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:30:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc73d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e'): ({'sdd'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Removing single pathed devices sdd {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:30:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b3dc7-13ef-4a9a-ba9a-fef3ad1ee10d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eae4bce-c5e7-4666-9b3c-7396cf5cb201]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Flushing IO for device /dev/sdd {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb320646-af65-4217-8505-f431bc9f4bf5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee8de6-307b-45bb-b83e-420d4f5cdfb0]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de42b3c4-3e93-466d-af93-41ec958e9a82]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[df393247-d11b-4660-aab4-fd04316c472a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]
Nov 06 22:30:03 user nova-compute[75000]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.
Nov 06 22:30:03 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe2558-72ba-40c4-8433-d0df441de0d7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] <== disconnect_volume: return (357ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully created port: 13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40_resize/disk /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully created port: 5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "cp -r /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40_resize/disk /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk" returned: 0 in 0.389s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40_resize/disk.info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk.info {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "cp -r /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40_resize/disk.info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk.info" returned: 0 in 0.033s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-f14eb65c-accf-4d97-8378-15f93ddd987b req-40c29e59-094a-4598-9977-d991c213866d service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f14eb65c-accf-4d97-8378-15f93ddd987b req-40c29e59-094a-4598-9977-d991c213866d service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f14eb65c-accf-4d97-8378-15f93ddd987b req-40c29e59-094a-4598-9977-d991c213866d service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f14eb65c-accf-4d97-8378-15f93ddd987b req-40c29e59-094a-4598-9977-d991c213866d service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-f14eb65c-accf-4d97-8378-15f93ddd987b req-40c29e59-094a-4598-9977-d991c213866d service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:04 user nova-compute[75000]: WARNING nova.compute.manager [req-f14eb65c-accf-4d97-8378-15f93ddd987b req-40c29e59-094a-4598-9977-d991c213866d service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state active and task_state resize_migrating.
Nov 06 22:30:04 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully created port: ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Port f6cb1907-7cf4-46fd-9526-9c885c806ce2 binding to destination host user is already ACTIVE {{(pid=75000) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully updated port: edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-43cb4ee3-0970-4481-bf21-634122c48c52 req-2e26a9ca-d48c-4376-94ce-99231b4ab74d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-changed-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-43cb4ee3-0970-4481-bf21-634122c48c52 req-2e26a9ca-d48c-4376-94ce-99231b4ab74d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing instance network info cache due to event network-changed-edd9c5b2-a58a-40e1-a90b-3369f3956182. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-43cb4ee3-0970-4481-bf21-634122c48c52 req-2e26a9ca-d48c-4376-94ce-99231b4ab74d service nova] Acquiring lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-43cb4ee3-0970-4481-bf21-634122c48c52 req-2e26a9ca-d48c-4376-94ce-99231b4ab74d service nova] Acquired lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-43cb4ee3-0970-4481-bf21-634122c48c52 req-2e26a9ca-d48c-4376-94ce-99231b4ab74d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing network info cache for port edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-43cb4ee3-0970-4481-bf21-634122c48c52 req-2e26a9ca-d48c-4376-94ce-99231b4ab74d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquired lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-43cb4ee3-0970-4481-bf21-634122c48c52 req-2e26a9ca-d48c-4376-94ce-99231b4ab74d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-43cb4ee3-0970-4481-bf21-634122c48c52 req-2e26a9ca-d48c-4376-94ce-99231b4ab74d service nova] Releasing lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance_info_cache with network_info: [{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Releasing lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG os_brick.utils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e553a2f-f72c-4f94-9839-6964a306b79b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e1d769-4349-4b1e-94af-afa428fe51e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cf54dd-1e46-4e95-b47f-85f66e97dbf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96091674-9b99-44ec-ad5d-2ce4385614dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully updated port: e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG nova.compute.manager [req-bf1b8639-02d7-4b48-af94-ad08d83e7637 req-59aab75e-ca34-4ca1-8fd6-cacbd20e652d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-changed-e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG nova.compute.manager [req-bf1b8639-02d7-4b48-af94-ad08d83e7637 req-59aab75e-ca34-4ca1-8fd6-cacbd20e652d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing instance network info cache due to event network-changed-e1a63239-aa0a-4355-9199-1b1def6d7343. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bf1b8639-02d7-4b48-af94-ad08d83e7637 req-59aab75e-ca34-4ca1-8fd6-cacbd20e652d service nova] Acquiring lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bf1b8639-02d7-4b48-af94-ad08d83e7637 req-59aab75e-ca34-4ca1-8fd6-cacbd20e652d service nova] Acquired lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-bf1b8639-02d7-4b48-af94-ad08d83e7637 req-59aab75e-ca34-4ca1-8fd6-cacbd20e652d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing network info cache for port e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:30:06 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:30:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[212293bf-43dd-425d-b5d2-5bc24c76013b]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:30:06 user nova-compute[75000]: DEBUG os_brick.utils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:30:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-bf1b8639-02d7-4b48-af94-ad08d83e7637 req-59aab75e-ca34-4ca1-8fd6-cacbd20e652d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:30:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-bf1b8639-02d7-4b48-af94-ad08d83e7637 req-59aab75e-ca34-4ca1-8fd6-cacbd20e652d service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bf1b8639-02d7-4b48-af94-ad08d83e7637 req-59aab75e-ca34-4ca1-8fd6-cacbd20e652d service nova] Releasing lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully updated port: f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:30:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-95f51547-d9d9-4669-8e66-5431b2f0b366 req-2bcbe848-355f-4a94-9d99-97a0b4b1e863 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-changed-f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-95f51547-d9d9-4669-8e66-5431b2f0b366 req-2bcbe848-355f-4a94-9d99-97a0b4b1e863 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing instance network info cache due to event network-changed-f5aefaa0-9af2-47b8-bcd2-3c572594b338. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:30:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-95f51547-d9d9-4669-8e66-5431b2f0b366 req-2bcbe848-355f-4a94-9d99-97a0b4b1e863 service nova] Acquiring lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-95f51547-d9d9-4669-8e66-5431b2f0b366 req-2bcbe848-355f-4a94-9d99-97a0b4b1e863 service nova] Acquired lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-95f51547-d9d9-4669-8e66-5431b2f0b366 req-2bcbe848-355f-4a94-9d99-97a0b4b1e863 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing network info cache for port f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:30:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-95f51547-d9d9-4669-8e66-5431b2f0b366 req-2bcbe848-355f-4a94-9d99-97a0b4b1e863 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:30:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully updated port: 8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:30:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-95f51547-d9d9-4669-8e66-5431b2f0b366 req-2bcbe848-355f-4a94-9d99-97a0b4b1e863 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-95f51547-d9d9-4669-8e66-5431b2f0b366 req-2bcbe848-355f-4a94-9d99-97a0b4b1e863 service nova] Releasing lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully updated port: 13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:30:10 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully updated port: 5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:30:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-changed-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing instance network info cache due to event network-changed-8a38f353-bd3b-4a59-a4d3-04728260fdf4. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:30:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] Acquiring lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] Acquired lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:10 user nova-compute[75000]: DEBUG nova.network.neutron [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing network info cache for port 8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] Releasing lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-changed-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing instance network info cache due to event network-changed-13a5c008-7743-43d9-89d9-79cb2eb79450. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] Acquiring lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] Acquired lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing network info cache for port 13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Successfully updated port: ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:30:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG nova.network.neutron [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] Releasing lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-changed-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing instance network info cache due to event network-changed-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] Acquiring lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] Acquired lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG nova.network.neutron [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing network info cache for port 5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG nova.network.neutron [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG nova.network.neutron [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ccc743aa-be08-42ec-a24b-9e88546d2aad req-fa03052e-39c7-4ce1-8e3c-967de00d2e36 service nova] Releasing lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquired lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:30:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-bc06e61b-3f74-4c8a-b99a-d9c0bfae4fad req-3558437f-115f-4d86-acaa-3e9b7cf9446b service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-changed-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-bc06e61b-3f74-4c8a-b99a-d9c0bfae4fad req-3558437f-115f-4d86-acaa-3e9b7cf9446b service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing instance network info cache due to event network-changed-ba040a18-e2d6-4599-a641-f459aed99c3c. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:30:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bc06e61b-3f74-4c8a-b99a-d9c0bfae4fad req-3558437f-115f-4d86-acaa-3e9b7cf9446b service nova] Acquiring lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [{"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Releasing lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance network_info: |[{"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bc06e61b-3f74-4c8a-b99a-d9c0bfae4fad req-3558437f-115f-4d86-acaa-3e9b7cf9446b service nova] Acquired lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG nova.network.neutron [req-bc06e61b-3f74-4c8a-b99a-d9c0bfae4fad req-3558437f-115f-4d86-acaa-3e9b7cf9446b service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing network info cache for port ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:15 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:30:15 user nova-compute[75000]: INFO nova.compute.claims [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Claim successful on node user
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-bc06e61b-3f74-4c8a-b99a-d9c0bfae4fad req-3558437f-115f-4d86-acaa-3e9b7cf9446b service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updated VIF entry in instance network info cache for port ba040a18-e2d6-4599-a641-f459aed99c3c. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-bc06e61b-3f74-4c8a-b99a-d9c0bfae4fad req-3558437f-115f-4d86-acaa-3e9b7cf9446b service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [{"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bc06e61b-3f74-4c8a-b99a-d9c0bfae4fad req-3558437f-115f-4d86-acaa-3e9b7cf9446b service nova] Releasing lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:30:16 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.policy [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20cf456ef1044f7387512475b494365e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248d06b9dfbf4cd69d8d9630aea9ab36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:30:16 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Creating image(s)
Nov 06 22:30:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "/opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "/opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.245s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Successfully created port: c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.235s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk 1073741824" returned: 0 in 0.053s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Cannot resize image /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Ensure instance console log exists: /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Successfully updated port: c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "refresh_cache-c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquired lock "refresh_cache-c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:17 user nova-compute[75000]: INFO nova.compute.manager [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Terminating instance
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-19d46ba7-4966-49de-bc18-a8de585ef716 req-45089087-b37f-4509-af4e-53d492879429 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received event network-changed-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-19d46ba7-4966-49de-bc18-a8de585ef716 req-45089087-b37f-4509-af4e-53d492879429 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Refreshing instance network info cache due to event network-changed-c89934ba-f1c6-4320-9ee9-dd60b163aa1d. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-19d46ba7-4966-49de-bc18-a8de585ef716 req-45089087-b37f-4509-af4e-53d492879429 service nova] Acquiring lock "refresh_cache-c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Updating instance_info_cache with network_info: [{"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Releasing lock "refresh_cache-c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Instance network_info: |[{"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-19d46ba7-4966-49de-bc18-a8de585ef716 req-45089087-b37f-4509-af4e-53d492879429 service nova] Acquired lock "refresh_cache-c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.neutron [req-19d46ba7-4966-49de-bc18-a8de585ef716 req-45089087-b37f-4509-af4e-53d492879429 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Refreshing network info cache for port c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Start _get_guest_xml network_info=[{"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:30:18 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:18 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1393190100',display_name='tempest-ServersNegativeTestJSON-server-1393190100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1393190100',id=16,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='248d06b9dfbf4cd69d8d9630aea9ab36',ramdisk_id='',reservation_id='r-fsg1x1u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1355389518',owner_user_name='tempest-ServersNegativeTestJSON-1355389518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:17Z,user_data=None,user_id='20cf456ef1044f7387512475b494365e',uuid=c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converting VIF {"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=c89934ba-f1c6-4320-9ee9-dd60b163aa1d,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc89934ba-f1') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.objects.instance [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lazy-loading 'pci_devices' on Instance uuid c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:30:18 user nova-compute[75000]:   <uuid>c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2</uuid>
Nov 06 22:30:18 user nova-compute[75000]:   <name>instance-00000010</name>
Nov 06 22:30:18 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:30:18 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:30:18 user nova-compute[75000]:   <metadata>
Nov 06 22:30:18 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:30:18 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:30:18 user nova-compute[75000]:       <nova:name>tempest-ServersNegativeTestJSON-server-1393190100</nova:name>
Nov 06 22:30:18 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:30:18</nova:creationTime>
Nov 06 22:30:18 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:30:18 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:30:18 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:30:18 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:30:18 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:30:18 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:30:18 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:30:18 user nova-compute[75000]:       <nova:owner>
Nov 06 22:30:18 user nova-compute[75000]:         <nova:user uuid="20cf456ef1044f7387512475b494365e">tempest-ServersNegativeTestJSON-1355389518-project-member</nova:user>
Nov 06 22:30:18 user nova-compute[75000]:         <nova:project uuid="248d06b9dfbf4cd69d8d9630aea9ab36">tempest-ServersNegativeTestJSON-1355389518</nova:project>
Nov 06 22:30:18 user nova-compute[75000]:       </nova:owner>
Nov 06 22:30:18 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:30:18 user nova-compute[75000]:       <nova:ports>
Nov 06 22:30:18 user nova-compute[75000]:         <nova:port uuid="c89934ba-f1c6-4320-9ee9-dd60b163aa1d">
Nov 06 22:30:18 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 22:30:18 user nova-compute[75000]:         </nova:port>
Nov 06 22:30:18 user nova-compute[75000]:       </nova:ports>
Nov 06 22:30:18 user nova-compute[75000]:     </nova:instance>
Nov 06 22:30:18 user nova-compute[75000]:   </metadata>
Nov 06 22:30:18 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:30:18 user nova-compute[75000]:     <system>
Nov 06 22:30:18 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:30:18 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:30:18 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:30:18 user nova-compute[75000]:       <entry name="serial">c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2</entry>
Nov 06 22:30:18 user nova-compute[75000]:       <entry name="uuid">c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2</entry>
Nov 06 22:30:18 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:30:18 user nova-compute[75000]:     </system>
Nov 06 22:30:18 user nova-compute[75000]:   </sysinfo>
Nov 06 22:30:18 user nova-compute[75000]:   <os>
Nov 06 22:30:18 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:30:18 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:30:18 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:30:18 user nova-compute[75000]:   </os>
Nov 06 22:30:18 user nova-compute[75000]:   <features>
Nov 06 22:30:18 user nova-compute[75000]:     <acpi/>
Nov 06 22:30:18 user nova-compute[75000]:     <apic/>
Nov 06 22:30:18 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:30:18 user nova-compute[75000]:   </features>
Nov 06 22:30:18 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:30:18 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:30:18 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:30:18 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:30:18 user nova-compute[75000]:   </clock>
Nov 06 22:30:18 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:30:18 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:30:18 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:30:18 user nova-compute[75000]:   </cpu>
Nov 06 22:30:18 user nova-compute[75000]:   <devices>
Nov 06 22:30:18 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:30:18 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:30:18 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk"/>
Nov 06 22:30:18 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:30:18 user nova-compute[75000]:     </disk>
Nov 06 22:30:18 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:30:18 user nova-compute[75000]:       <mac address="fa:16:3e:e6:6d:c5"/>
Nov 06 22:30:18 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:30:18 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:30:18 user nova-compute[75000]:       <target dev="tapc89934ba-f1"/>
Nov 06 22:30:18 user nova-compute[75000]:     </interface>
Nov 06 22:30:18 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:30:18 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/console.log" append="off"/>
Nov 06 22:30:18 user nova-compute[75000]:     </serial>
Nov 06 22:30:18 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:30:18 user nova-compute[75000]:     <video>
Nov 06 22:30:18 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:30:18 user nova-compute[75000]:     </video>
Nov 06 22:30:18 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:30:18 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:30:18 user nova-compute[75000]:     </rng>
Nov 06 22:30:18 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:30:18 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:30:18 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:30:18 user nova-compute[75000]:     </memballoon>
Nov 06 22:30:18 user nova-compute[75000]:   </devices>
Nov 06 22:30:18 user nova-compute[75000]: </domain>
Nov 06 22:30:18 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1393190100',display_name='tempest-ServersNegativeTestJSON-server-1393190100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1393190100',id=16,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='248d06b9dfbf4cd69d8d9630aea9ab36',ramdisk_id='',reservation_id='r-fsg1x1u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1355389518',owner_user_name='tempest-ServersNegativeTestJSON-1355389518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:17Z,user_data=None,user_id='20cf456ef1044f7387512475b494365e',uuid=c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converting VIF {"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=c89934ba-f1c6-4320-9ee9-dd60b163aa1d,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc89934ba-f1') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG os_vif [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=c89934ba-f1c6-4320-9ee9-dd60b163aa1d,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc89934ba-f1') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e245acaa-fbf4-5934-bf75-c0e2aea98a20', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc89934ba-f1, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc89934ba-f1, col_values=(('qos', UUID('9a8534d3-bf9f-4d9b-bddd-f3341cea4fc8')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc89934ba-f1, col_values=(('external_ids', {'iface-id': 'c89934ba-f1c6-4320-9ee9-dd60b163aa1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:6d:c5', 'vm-uuid': 'c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: INFO os_vif [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=c89934ba-f1c6-4320-9ee9-dd60b163aa1d,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc89934ba-f1')
Nov 06 22:30:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Instance destroyed successfully.
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lazy-loading 'resources' on Instance uuid 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] No VIF found with MAC fa:16:3e:e6:6d:c5, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1560055579',display_name='tempest-VolumesActionsTest-instance-1560055579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1560055579',id=12,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:28:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8f0e789571a4a63b90b26c9a5b0c954',ramdisk_id='',reservation_id='r-23n4opfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-297854992',owner_user_name='tempest-VolumesActionsTest-297854992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:28:35Z,user_data=None,user_id='afc6c795f94d4469825b1ceac5bb2ccb',uuid=6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "address": "fa:16:3e:5f:e6:98", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0e773f-8a", "ovs_interfaceid": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converting VIF {"id": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "address": "fa:16:3e:5f:e6:98", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0e773f-8a", "ovs_interfaceid": "aa0e773f-8a3e-4e26-b935-4e993cbf6c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:98,bridge_name='br-int',has_traffic_filtering=True,id=aa0e773f-8a3e-4e26-b935-4e993cbf6c5b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0e773f-8a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG os_vif [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:98,bridge_name='br-int',has_traffic_filtering=True,id=aa0e773f-8a3e-4e26-b935-4e993cbf6c5b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0e773f-8a') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa0e773f-8a, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb4eb265-458a-455c-a5f1-1f1d0810623e) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:18 user nova-compute[75000]: INFO os_vif [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e6:98,bridge_name='br-int',has_traffic_filtering=True,id=aa0e773f-8a3e-4e26-b935-4e993cbf6c5b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0e773f-8a')
Nov 06 22:30:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Deleting instance files /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e_del
Nov 06 22:30:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Deletion of /opt/stack/data/nova/instances/6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e_del complete
Nov 06 22:30:18 user nova-compute[75000]: INFO nova.compute.manager [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 06 22:30:18 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.neutron [req-19d46ba7-4966-49de-bc18-a8de585ef716 req-45089087-b37f-4509-af4e-53d492879429 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Updated VIF entry in instance network info cache for port c89934ba-f1c6-4320-9ee9-dd60b163aa1d. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG nova.network.neutron [req-19d46ba7-4966-49de-bc18-a8de585ef716 req-45089087-b37f-4509-af4e-53d492879429 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Updating instance_info_cache with network_info: [{"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-19d46ba7-4966-49de-bc18-a8de585ef716 req-45089087-b37f-4509-af4e-53d492879429 service nova] Releasing lock "refresh_cache-c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:19 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Took 0.52 seconds to deallocate network for instance.
Nov 06 22:30:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:19 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Deleted allocations for instance 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e
Nov 06 22:30:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8e5766a-fc7d-4f41-a3c6-4c0f8d161957 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.968s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e224e71-0bbd-4597-b2aa-24ca84c397b3 req-452138b7-4e73-4079-997e-e6bd5acc6884 service nova] [instance: 6b2cf51c-62b8-4ff1-9a59-b0d4af6b235e] Received event network-vif-deleted-aa0e773f-8a3e-4e26-b935-4e993cbf6c5b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-046bd5e8-a9a3-4cf0-89d7-0b161911368d req-ac220568-b5a1-4bdb-ab1d-5b93566469a5 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received event network-vif-plugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-046bd5e8-a9a3-4cf0-89d7-0b161911368d req-ac220568-b5a1-4bdb-ab1d-5b93566469a5 service nova] Acquiring lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-046bd5e8-a9a3-4cf0-89d7-0b161911368d req-ac220568-b5a1-4bdb-ab1d-5b93566469a5 service nova] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-046bd5e8-a9a3-4cf0-89d7-0b161911368d req-ac220568-b5a1-4bdb-ab1d-5b93566469a5 service nova] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-046bd5e8-a9a3-4cf0-89d7-0b161911368d req-ac220568-b5a1-4bdb-ab1d-5b93566469a5 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] No waiting events found dispatching network-vif-plugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:20 user nova-compute[75000]: WARNING nova.compute.manager [req-046bd5e8-a9a3-4cf0-89d7-0b161911368d req-ac220568-b5a1-4bdb-ab1d-5b93566469a5 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received unexpected event network-vif-plugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d for instance with vm_state building and task_state spawning.
Nov 06 22:30:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:21 user nova-compute[75000]: INFO nova.compute.manager [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Rescuing
Nov 06 22:30:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquired lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:21 user nova-compute[75000]: DEBUG nova.network.neutron [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.network.neutron [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updating instance_info_cache with network_info: [{"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-a22cbe2f-e28b-46a4-8dbd-a2c4e9bf279f req-1011f2c8-910e-4e55-8e03-ec0e6442987f service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received event network-vif-plugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a22cbe2f-e28b-46a4-8dbd-a2c4e9bf279f req-1011f2c8-910e-4e55-8e03-ec0e6442987f service nova] Acquiring lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a22cbe2f-e28b-46a4-8dbd-a2c4e9bf279f req-1011f2c8-910e-4e55-8e03-ec0e6442987f service nova] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a22cbe2f-e28b-46a4-8dbd-a2c4e9bf279f req-1011f2c8-910e-4e55-8e03-ec0e6442987f service nova] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-a22cbe2f-e28b-46a4-8dbd-a2c4e9bf279f req-1011f2c8-910e-4e55-8e03-ec0e6442987f service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] No waiting events found dispatching network-vif-plugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:22 user nova-compute[75000]: WARNING nova.compute.manager [req-a22cbe2f-e28b-46a4-8dbd-a2c4e9bf279f req-1011f2c8-910e-4e55-8e03-ec0e6442987f service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received unexpected event network-vif-plugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d for instance with vm_state building and task_state spawning.
Nov 06 22:30:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Releasing lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:30:22 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Instance spawned successfully.
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:30:22 user nova-compute[75000]: INFO nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 06 22:30:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:30:22 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Instance destroyed successfully.
Nov 06 22:30:22 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Attempting a stable device rescue
Nov 06 22:30:23 user nova-compute[75000]: INFO nova.compute.manager [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Took 7.13 seconds to build instance.
Nov 06 22:30:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 22:30:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Instance directory exists: not creating {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 22:30:23 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Creating image(s)
Nov 06 22:30:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "/opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "/opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:23 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b78d8a2-fa9a-4a99-aa8c-6e130d73e3c9 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.228s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "39803db4fba992a09bf136a780a875ac147de9ef" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "39803db4fba992a09bf136a780a875ac147de9ef" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-unplugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-unplugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:24 user nova-compute[75000]: WARNING nova.compute.manager [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-unplugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state active and task_state rescuing.
Nov 06 22:30:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:24 user nova-compute[75000]: WARNING nova.compute.manager [req-d4f06a7e-b7fd-46e1-b76e-f1dab96c1363 req-52536e75-5d43-45a4-b277-bb7b2bb2dbdd service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state active and task_state rescuing.
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG nova.virt.images [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] bb10442a-87ed-4df1-b280-3fcc3fb557b6 was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef.part /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef.part /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef.converted" returned: 0 in 0.303s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "39803db4fba992a09bf136a780a875ac147de9ef" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "39803db4fba992a09bf136a780a875ac147de9ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "39803db4fba992a09bf136a780a875ac147de9ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef,backing_fmt=raw /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef,backing_fmt=raw /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue" returned: 0 in 0.048s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "39803db4fba992a09bf136a780a875ac147de9ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'migration_context' on Instance uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<d3e6809f-acbd-4763-8d7e-6e748aeab307> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Start _get_guest_xml network_info=[{"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "vif_mac": "fa:16:3e:a7:7b:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb10442a-87ed-4df1-b280-3fcc3fb557b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNHpGySu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd3e6809f-acbd-4763-8d7e-6e748aeab307', 'attached_at': '', 'detached_at': '', 'volume_id': '20156e99-9d0d-4fd7-8b1f-78eb97a74200', 'serial': '20156e99-9d0d-4fd7-8b1f-78eb97a74200'}, 'attachment_id': '7d5f2abc-a101-42cd-ab57-6e9639ed95b4', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'resources' on Instance uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<d3e6809f-acbd-4763-8d7e-6e748aeab307> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'numa_topology' on Instance uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<d3e6809f-acbd-4763-8d7e-6e748aeab307> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:25 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:25 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<d3e6809f-acbd-4763-8d7e-6e748aeab307> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNHpGySu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:30:25 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:30:25 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:30:25 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35a3b3d-7cb7-4c39-a5fe-fc9d616cf2c3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BNHpGySu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 22:30:25 user nova-compute[75000]: node.name = iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:30:25 user nova-compute[75000]: node.tpgt = -1
Nov 06 22:30:25 user nova-compute[75000]: node.startup = automatic
Nov 06 22:30:25 user nova-compute[75000]: node.leading_login = No
Nov 06 22:30:25 user nova-compute[75000]: iface.iscsi_ifacename = default
Nov 06 22:30:25 user nova-compute[75000]: iface.net_ifacename = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.ipaddress = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.prefix_len = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.hwaddress = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.transport_name = tcp
Nov 06 22:30:25 user nova-compute[75000]: iface.initiatorname = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.state = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.vlan_id = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.vlan_priority = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.vlan_state = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.iface_num = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.mtu = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.port = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.bootproto = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.subnet_mask = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.gateway = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.dhcp_alt_client_id = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.dhcp_dns = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.dhcp_learn_iqn = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.dhcp_vendor_id_state = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.dhcp_vendor_id = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.dhcp_slp_da = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.fragmentation = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.gratuitous_arp = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.incoming_forwarding = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.tos_state = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.tos = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.ttl = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.delayed_ack = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.tcp_nagle = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.tcp_wsf_state = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.tcp_wsf = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.tcp_timer_scale = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.tcp_timestamp = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.redirect = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.def_task_mgmt_timeout = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.header_digest = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.data_digest = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.immediate_data = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.initial_r2t = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.data_seq_inorder = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.data_pdu_inorder = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.erl = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.max_receive_data_len = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.first_burst_len = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.max_outstanding_r2t = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.max_burst_len = 0
Nov 06 22:30:25 user nova-compute[75000]: iface.chap_auth = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.bidi_chap = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.strict_login_compliance = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.discovery_auth = <empty>
Nov 06 22:30:25 user nova-compute[75000]: iface.discovery_logout = <empty>
Nov 06 22:30:25 user nova-compute[75000]: node.discovery_address = <empty>
Nov 06 22:30:25 user nova-compute[75000]: node.discovery_port = 0
Nov 06 22:30:25 user nova-compute[75000]: node.discovery_type = static
Nov 06 22:30:25 user nova-compute[75000]: node.session.initial_cmdsn = 0
Nov 06 22:30:25 user nova-compute[75000]: node.session.initial_login_retry_max = 8
Nov 06 22:30:25 user nova-compute[75000]: node.session.xmit_thread_priority = -20
Nov 06 22:30:25 user nova-compute[75000]: node.session.cmds_max = 128
Nov 06 22:30:25 user nova-compute[75000]: node.session.queue_depth = 32
Nov 06 22:30:25 user nova-compute[75000]: node.session.nr_sessions = 1
Nov 06 22:30:25 user nova-compute[75000]: node.session.auth.authmethod = CHAP
Nov 06 22:30:25 user nova-compute[75000]: node.session.auth.username = BNHpGySu
Nov 06 22:30:25 user nova-compute[75000]: node.session.auth.password = ***
Nov 06 22:30:25 user nova-compute[75000]: node.session.auth.username_in = <empty>
Nov 06 22:30:25 user nova-compute[75000]: node.session.auth.password_in = <empty>
Nov 06 22:30:25 user nova-compute[75000]: node.session.auth.chap_algs = MD5
Nov 06 22:30:25 user nova-compute[75000]: node.session.timeo.replacement_timeout = 120
Nov 06 22:30:25 user nova-compute[75000]: node.session.err_timeo.abort_timeout = 15
Nov 06 22:30:25 user nova-compute[75000]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 22:30:25 user nova-compute[75000]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 22:30:25 user nova-compute[75000]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.FastAbort = Yes
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.InitialR2T = No
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.ImmediateData = Yes
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.MaxConnections = 1
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 22:30:25 user nova-compute[75000]: node.session.iscsi.ERL = 0
Nov 06 22:30:25 user nova-compute[75000]: node.session.scan = manual
Nov 06 22:30:25 user nova-compute[75000]: node.session.reopen_max = 0
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].address = 172.16.0.220
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].port = 3260
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].startup = manual
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].tcp.window_size = 524288
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].tcp.type_of_service = 0
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].timeo.logout_timeout = 15
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].timeo.login_timeout = 15
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].timeo.auth_timeout = 45
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].iscsi.DataDigest = None
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].iscsi.IFMarker = No
Nov 06 22:30:25 user nova-compute[75000]: node.conn[0].iscsi.OFMarker = No
Nov 06 22:30:25 user nova-compute[75000]: # END RECORD
Nov 06 22:30:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1dc690-ed6c-4ad9-b667-8e29cf1d005f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3482b481-4f20-4c87-b7f7-8d7d6194fe0d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNHpGySu {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNHpGySu" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff58ea2-b52f-41d8-965d-872bd0698c25]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNHpGySu'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3a659-eb32-4409-9790-b725ff7395db]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3c00b1-6a84-4b2f-9357-d636c4f4fb77]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:30:25 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:30:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:30:25 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:30:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] HCTL ('33', '0', '0', 0) found on session 7 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d4f9a1-c06f-4fc6-bec5-16e44094f0de]: (4, ('0 0 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching for a device in session 7 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNHpGySu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '23265396165666539', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265396165666539', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-487460800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-487460800',id=13,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:29:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-yuq7rxnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:29:07Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=d3e6809f-acbd-4763-8d7e-6e748aeab307,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "vif_mac": "fa:16:3e:a7:7b:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "vif_mac": "fa:16:3e:a7:7b:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7b:51,bridge_name='br-int',has_traffic_filtering=True,id=04dc5619-eedb-4e04-8f38-cb414d77eb54,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc5619-ee') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'pci_devices' on Instance uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.objects.base [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<d3e6809f-acbd-4763-8d7e-6e748aeab307> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:30:25 user nova-compute[75000]:   <uuid>d3e6809f-acbd-4763-8d7e-6e748aeab307</uuid>
Nov 06 22:30:25 user nova-compute[75000]:   <name>instance-0000000d</name>
Nov 06 22:30:25 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:30:25 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:30:25 user nova-compute[75000]:   <metadata>
Nov 06 22:30:25 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:30:25 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:30:25 user nova-compute[75000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-487460800</nova:name>
Nov 06 22:30:25 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:30:25</nova:creationTime>
Nov 06 22:30:25 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:30:25 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:30:25 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:30:25 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:30:25 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:30:25 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:30:25 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:30:25 user nova-compute[75000]:       <nova:owner>
Nov 06 22:30:25 user nova-compute[75000]:         <nova:user uuid="ddbbf039233142eca9f4cdfe2396da7c">tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member</nova:user>
Nov 06 22:30:25 user nova-compute[75000]:         <nova:project uuid="3a7a8c838f784f309fb9f0066e3463ae">tempest-ServerBootFromVolumeStableRescueTest-294256413</nova:project>
Nov 06 22:30:25 user nova-compute[75000]:       </nova:owner>
Nov 06 22:30:25 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:30:25 user nova-compute[75000]:       <nova:ports>
Nov 06 22:30:25 user nova-compute[75000]:         <nova:port uuid="04dc5619-eedb-4e04-8f38-cb414d77eb54">
Nov 06 22:30:25 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 06 22:30:25 user nova-compute[75000]:         </nova:port>
Nov 06 22:30:25 user nova-compute[75000]:       </nova:ports>
Nov 06 22:30:25 user nova-compute[75000]:     </nova:instance>
Nov 06 22:30:25 user nova-compute[75000]:   </metadata>
Nov 06 22:30:25 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:30:25 user nova-compute[75000]:     <system>
Nov 06 22:30:25 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:30:25 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:30:25 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:30:25 user nova-compute[75000]:       <entry name="serial">d3e6809f-acbd-4763-8d7e-6e748aeab307</entry>
Nov 06 22:30:25 user nova-compute[75000]:       <entry name="uuid">d3e6809f-acbd-4763-8d7e-6e748aeab307</entry>
Nov 06 22:30:25 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:30:25 user nova-compute[75000]:     </system>
Nov 06 22:30:25 user nova-compute[75000]:   </sysinfo>
Nov 06 22:30:25 user nova-compute[75000]:   <os>
Nov 06 22:30:25 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:30:25 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:30:25 user nova-compute[75000]:   </os>
Nov 06 22:30:25 user nova-compute[75000]:   <features>
Nov 06 22:30:25 user nova-compute[75000]:     <acpi/>
Nov 06 22:30:25 user nova-compute[75000]:     <apic/>
Nov 06 22:30:25 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:30:25 user nova-compute[75000]:   </features>
Nov 06 22:30:25 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:30:25 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:30:25 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:30:25 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:30:25 user nova-compute[75000]:   </clock>
Nov 06 22:30:25 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:30:25 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:30:25 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:30:25 user nova-compute[75000]:   </cpu>
Nov 06 22:30:25 user nova-compute[75000]:   <devices>
Nov 06 22:30:25 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:30:25 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:30:25 user nova-compute[75000]:       <source dev="/dev/sdb"/>
Nov 06 22:30:25 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:30:25 user nova-compute[75000]:       <serial>20156e99-9d0d-4fd7-8b1f-78eb97a74200</serial>
Nov 06 22:30:25 user nova-compute[75000]:     </disk>
Nov 06 22:30:25 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:30:25 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:30:25 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue"/>
Nov 06 22:30:25 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:30:25 user nova-compute[75000]:       <boot order="1"/>
Nov 06 22:30:25 user nova-compute[75000]:     </disk>
Nov 06 22:30:25 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:30:25 user nova-compute[75000]:       <mac address="fa:16:3e:a7:7b:51"/>
Nov 06 22:30:25 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:30:25 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:30:25 user nova-compute[75000]:       <target dev="tap04dc5619-ee"/>
Nov 06 22:30:25 user nova-compute[75000]:     </interface>
Nov 06 22:30:25 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:30:25 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/console.log" append="off"/>
Nov 06 22:30:25 user nova-compute[75000]:     </serial>
Nov 06 22:30:25 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:30:25 user nova-compute[75000]:     <video>
Nov 06 22:30:25 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:30:25 user nova-compute[75000]:     </video>
Nov 06 22:30:25 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:30:25 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:30:25 user nova-compute[75000]:     </rng>
Nov 06 22:30:25 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:30:25 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:30:25 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:30:25 user nova-compute[75000]:     </memballoon>
Nov 06 22:30:25 user nova-compute[75000]:   </devices>
Nov 06 22:30:25 user nova-compute[75000]: </domain>
Nov 06 22:30:25 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:30:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Instance destroyed successfully.
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No VIF found with MAC fa:16:3e:a7:7b:51, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:30:25 user nova-compute[75000]: INFO nova.virt.block_device [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Booting with volume 0883f49d-f390-4aba-8a64-388111d2b818 at /dev/vdb
Nov 06 22:30:25 user nova-compute[75000]: DEBUG os_brick.utils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc04a9a2-78e0-47d1-b2c7-7d4c9197e22f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab10a6ef-4d15-424f-a8c7-1a5ed6b8b6cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ce112-5c2d-461b-ba39-fe1e11edebaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a72c7b2-0f0b-4738-899b-b5ce97edddb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:30:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:30:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:30:26 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:30:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f8ca29-ff99-4eeb-9513-4f5e1b9b8662]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:30:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:30:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:30:26 user nova-compute[75000]: DEBUG os_brick.utils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:30:26 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating existing volume attachment record: ab53337a-ad3d-4ea2-a25b-476454314eec {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG nova.compute.manager [req-87ee220c-64fe-4c3a-a900-86cb1a0df9c2 req-439f79d2-23a3-49b9-a76f-3db054b36962 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87ee220c-64fe-4c3a-a900-86cb1a0df9c2 req-439f79d2-23a3-49b9-a76f-3db054b36962 service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87ee220c-64fe-4c3a-a900-86cb1a0df9c2 req-439f79d2-23a3-49b9-a76f-3db054b36962 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87ee220c-64fe-4c3a-a900-86cb1a0df9c2 req-439f79d2-23a3-49b9-a76f-3db054b36962 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG nova.compute.manager [req-87ee220c-64fe-4c3a-a900-86cb1a0df9c2 req-439f79d2-23a3-49b9-a76f-3db054b36962 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:27 user nova-compute[75000]: WARNING nova.compute.manager [req-87ee220c-64fe-4c3a-a900-86cb1a0df9c2 req-439f79d2-23a3-49b9-a76f-3db054b36962 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state active and task_state rescuing.
Nov 06 22:30:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:27 user nova-compute[75000]: INFO nova.compute.manager [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Rescuing
Nov 06 22:30:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquired lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG nova.network.neutron [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updating instance_info_cache with network_info: [{"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG nova.network.neutron [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updating instance_info_cache with network_info: [{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Releasing lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Instance destroyed successfully.
Nov 06 22:30:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Attempting rescue
Nov 06 22:30:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Instance directory exists: not creating {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 22:30:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Creating image(s)
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG nova.objects.instance [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'trusted_certs' on Instance uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.218s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue" returned: 0 in 0.049s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'migration_context' on Instance uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.base [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<f48bca3c-8e15-4729-a01c-9741c4794a2f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Start _get_guest_xml network_info=[{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "vif_mac": "fa:16:3e:e4:ec:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'resources' on Instance uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.base [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<f48bca3c-8e15-4729-a01c-9741c4794a2f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'numa_topology' on Instance uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.base [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<f48bca3c-8e15-4729-a01c-9741c4794a2f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:29 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:29 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'vcpu_model' on Instance uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.base [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<f48bca3c-8e15-4729-a01c-9741c4794a2f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1791801885',display_name='tempest-ServerRescueNegativeTestJSON-server-1791801885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1791801885',id=4,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:25:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-3wtyelfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:25:56Z,user_data=None,user_id='f50e6a64752e488b9699a8bdda46253c',uuid=f48bca3c-8e15-4729-a01c-9741c4794a2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "vif_mac": "fa:16:3e:e4:ec:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "vif_mac": "fa:16:3e:e4:ec:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=f671c9ae-e9f9-4276-8291-76aaf4510fa8,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf671c9ae-e9') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'pci_devices' on Instance uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.objects.base [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<f48bca3c-8e15-4729-a01c-9741c4794a2f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:30:29 user nova-compute[75000]:   <uuid>f48bca3c-8e15-4729-a01c-9741c4794a2f</uuid>
Nov 06 22:30:29 user nova-compute[75000]:   <name>instance-00000004</name>
Nov 06 22:30:29 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:30:29 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:30:29 user nova-compute[75000]:   <metadata>
Nov 06 22:30:29 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:30:29 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:30:29 user nova-compute[75000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1791801885</nova:name>
Nov 06 22:30:29 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:30:29</nova:creationTime>
Nov 06 22:30:29 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:30:29 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:30:29 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:30:29 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:30:29 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:30:29 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:30:29 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:30:29 user nova-compute[75000]:       <nova:owner>
Nov 06 22:30:29 user nova-compute[75000]:         <nova:user uuid="f50e6a64752e488b9699a8bdda46253c">tempest-ServerRescueNegativeTestJSON-259573853-project-member</nova:user>
Nov 06 22:30:29 user nova-compute[75000]:         <nova:project uuid="5b4b9d5ecee54acb8ca3534a38500b4f">tempest-ServerRescueNegativeTestJSON-259573853</nova:project>
Nov 06 22:30:29 user nova-compute[75000]:       </nova:owner>
Nov 06 22:30:29 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:30:29 user nova-compute[75000]:       <nova:ports>
Nov 06 22:30:29 user nova-compute[75000]:         <nova:port uuid="f671c9ae-e9f9-4276-8291-76aaf4510fa8">
Nov 06 22:30:29 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:30:29 user nova-compute[75000]:         </nova:port>
Nov 06 22:30:29 user nova-compute[75000]:       </nova:ports>
Nov 06 22:30:29 user nova-compute[75000]:     </nova:instance>
Nov 06 22:30:29 user nova-compute[75000]:   </metadata>
Nov 06 22:30:29 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:30:29 user nova-compute[75000]:     <system>
Nov 06 22:30:29 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:30:29 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:30:29 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:30:29 user nova-compute[75000]:       <entry name="serial">f48bca3c-8e15-4729-a01c-9741c4794a2f</entry>
Nov 06 22:30:29 user nova-compute[75000]:       <entry name="uuid">f48bca3c-8e15-4729-a01c-9741c4794a2f</entry>
Nov 06 22:30:29 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:30:29 user nova-compute[75000]:     </system>
Nov 06 22:30:29 user nova-compute[75000]:   </sysinfo>
Nov 06 22:30:29 user nova-compute[75000]:   <os>
Nov 06 22:30:29 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:30:29 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:30:29 user nova-compute[75000]:   </os>
Nov 06 22:30:29 user nova-compute[75000]:   <features>
Nov 06 22:30:29 user nova-compute[75000]:     <acpi/>
Nov 06 22:30:29 user nova-compute[75000]:     <apic/>
Nov 06 22:30:29 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:30:29 user nova-compute[75000]:   </features>
Nov 06 22:30:29 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:30:29 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:30:29 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:30:29 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:30:29 user nova-compute[75000]:   </clock>
Nov 06 22:30:29 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:30:29 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:30:29 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:30:29 user nova-compute[75000]:   </cpu>
Nov 06 22:30:29 user nova-compute[75000]:   <devices>
Nov 06 22:30:29 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:30:29 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:30:29 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue"/>
Nov 06 22:30:29 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:30:29 user nova-compute[75000]:     </disk>
Nov 06 22:30:29 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:30:29 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:30:29 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk"/>
Nov 06 22:30:29 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:30:29 user nova-compute[75000]:     </disk>
Nov 06 22:30:29 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:30:29 user nova-compute[75000]:       <mac address="fa:16:3e:e4:ec:d9"/>
Nov 06 22:30:29 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:30:29 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:30:29 user nova-compute[75000]:       <target dev="tapf671c9ae-e9"/>
Nov 06 22:30:29 user nova-compute[75000]:     </interface>
Nov 06 22:30:29 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:30:29 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/console.log" append="off"/>
Nov 06 22:30:29 user nova-compute[75000]:     </serial>
Nov 06 22:30:29 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:30:29 user nova-compute[75000]:     <video>
Nov 06 22:30:29 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:30:29 user nova-compute[75000]:     </video>
Nov 06 22:30:29 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:30:29 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:30:29 user nova-compute[75000]:     </rng>
Nov 06 22:30:29 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:30:29 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:30:29 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:30:29 user nova-compute[75000]:     </memballoon>
Nov 06 22:30:29 user nova-compute[75000]:   </devices>
Nov 06 22:30:29 user nova-compute[75000]: </domain>
Nov 06 22:30:29 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:30:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Instance destroyed successfully.
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No VIF found with MAC fa:16:3e:e4:ec:d9, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:29 user nova-compute[75000]: WARNING nova.compute.manager [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state active and task_state rescuing.
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-unplugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-unplugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:29 user nova-compute[75000]: WARNING nova.compute.manager [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-unplugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state active and task_state rescuing.
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:29 user nova-compute[75000]: WARNING nova.compute.manager [req-0e74d2dc-5aab-4aae-a74c-1eeb73fb9620 req-ddfa5056-6348-4b37-bd57-93ab704121b8 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state active and task_state rescuing.
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-e73eb714-dad6-4333-ad63-7e982d6405c2 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:30:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-8008d253-b59a-46c4-89bf-9c173e3d5f2c req-ade27b43-ef44-4896-8864-1bd38351ea40 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8008d253-b59a-46c4-89bf-9c173e3d5f2c req-ade27b43-ef44-4896-8864-1bd38351ea40 service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8008d253-b59a-46c4-89bf-9c173e3d5f2c req-ade27b43-ef44-4896-8864-1bd38351ea40 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8008d253-b59a-46c4-89bf-9c173e3d5f2c req-ade27b43-ef44-4896-8864-1bd38351ea40 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-8008d253-b59a-46c4-89bf-9c173e3d5f2c req-ade27b43-ef44-4896-8864-1bd38351ea40 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:31 user nova-compute[75000]: WARNING nova.compute.manager [req-8008d253-b59a-46c4-89bf-9c173e3d5f2c req-ade27b43-ef44-4896-8864-1bd38351ea40 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state active and task_state rescuing.
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Starting finish_migration {{(pid=75000) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance directory exists: not creating {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 22:30:32 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Creating image(s)
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.293s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.394s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk. size=21474836480 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk 21474836480 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk 21474836480" returned: 0 in 0.067s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Ensure instance console log exists: /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Start _get_guest_xml network_info=[{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-651500099-network", "vif_mac": "fa:16:3e:4f:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '846bf5e2-230c-419c-be77-982acc036b40', 'attached_at': '2023-11-06T22:30:32.000000', 'detached_at': '', 'volume_id': 'b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'serial': 'b12a60c7-2bb6-4f35-84f2-a15588cc9e8e'}, 'attachment_id': '2cd376a9-7b3a-473b-94a4-132435ce3272', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:30:32 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:32 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:30:33 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:30:33 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:30:33 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8bdfea-c07a-43f5-a8ce-6e8c35428483]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:30:33 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b3d6fb-bfa2-44b6-b7fb-f888dacc4139]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e] added
Nov 06 22:30:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd0edb1-453e-4cd3-91f2-c0dfec52769d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf59ae6-a4ea-45ee-870a-b47024f7a929]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wopgvcrh {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wopgvcrh" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0338a7a7-d7c5-487a-918c-16f493515bf6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wopgvcrh'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46af296-6ca0-4a5c-a603-2e824fcdb657]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef390f04-e02a-4ccb-98d1-fd8ffb2a8d30]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:30:33 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:30:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:30:33 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:30:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd4b6be-bf2a-40dc-a960-03aefa6553e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]
Nov 06 22:30:33 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.
Nov 06 22:30:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e7af51-91ab-416c-bccc-ee7cd4a0d38f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba9151c-5a86-4d98-bd18-a9c4ea8c5e55]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:30:33 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:30:33 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:30:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:30:33 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:30:33 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:30:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8707693-6a03-4516-845f-c27dd635cd4f]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.compute.manager [req-72981faf-3407-4b9a-bb8e-d569e5c74090 req-1b823921-8fd4-4577-b985-2e2dad4878fc service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-72981faf-3407-4b9a-bb8e-d569e5c74090 req-1b823921-8fd4-4577-b985-2e2dad4878fc service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-72981faf-3407-4b9a-bb8e-d569e5c74090 req-1b823921-8fd4-4577-b985-2e2dad4878fc service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-72981faf-3407-4b9a-bb8e-d569e5c74090 req-1b823921-8fd4-4577-b985-2e2dad4878fc service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.compute.manager [req-72981faf-3407-4b9a-bb8e-d569e5c74090 req-1b823921-8fd4-4577-b985-2e2dad4878fc service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:33 user nova-compute[75000]: WARNING nova.compute.manager [req-72981faf-3407-4b9a-bb8e-d569e5c74090 req-1b823921-8fd4-4577-b985-2e2dad4878fc service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state active and task_state rescuing.
Nov 06 22:30:33 user nova-compute[75000]: DEBUG nova.compute.manager [None req-239d2286-a2f9-40e5-a040-f3655e209edb tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23464613137396432', 'path': '/dev/sdd'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464613137396432', 'path': '/dev/sdd'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-410044661',display_name='tempest-ServerActionsTestOtherB-server-410044661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-410044661',id=6,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN127j9rMCzJhcsyMMnA9oMyDSW626YDveQjSPb2IR7mcffJ8blZhWvgtIPRXJ9KDmmNRktgeSU8SDicFRInDOK2YoxINbUZ+i2iHac2q1b7ra/rMkxI3W72lm49ZRgf7w==',key_name='tempest-keypair-1677332467',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:25:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54eb33cd621c4fa78fead18be74916ee',ramdisk_id='',reservation_id='r-nlmmujhg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-408033839',owner_user_name='tempest-ServerActionsTestOtherB-408033839-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8b116c4cb154ce0a1a80045258cd123',uuid=846bf5e2-230c-419c-be77-982acc036b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-651500099-network", "vif_mac": "fa:16:3e:4f:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converting VIF {"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-651500099-network", "vif_mac": "fa:16:3e:4f:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:30:34 user nova-compute[75000]:   <uuid>846bf5e2-230c-419c-be77-982acc036b40</uuid>
Nov 06 22:30:34 user nova-compute[75000]:   <name>instance-00000006</name>
Nov 06 22:30:34 user nova-compute[75000]:   <memory>2097152</memory>
Nov 06 22:30:34 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:30:34 user nova-compute[75000]:   <metadata>
Nov 06 22:30:34 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:30:34 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:30:34 user nova-compute[75000]:       <nova:name>tempest-ServerActionsTestOtherB-server-410044661</nova:name>
Nov 06 22:30:34 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:30:32</nova:creationTime>
Nov 06 22:30:34 user nova-compute[75000]:       <nova:flavor name="m1.small">
Nov 06 22:30:34 user nova-compute[75000]:         <nova:memory>2048</nova:memory>
Nov 06 22:30:34 user nova-compute[75000]:         <nova:disk>20</nova:disk>
Nov 06 22:30:34 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:30:34 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:30:34 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:30:34 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:30:34 user nova-compute[75000]:       <nova:owner>
Nov 06 22:30:34 user nova-compute[75000]:         <nova:user uuid="c8b116c4cb154ce0a1a80045258cd123">tempest-ServerActionsTestOtherB-408033839-project-member</nova:user>
Nov 06 22:30:34 user nova-compute[75000]:         <nova:project uuid="54eb33cd621c4fa78fead18be74916ee">tempest-ServerActionsTestOtherB-408033839</nova:project>
Nov 06 22:30:34 user nova-compute[75000]:       </nova:owner>
Nov 06 22:30:34 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:30:34 user nova-compute[75000]:       <nova:ports>
Nov 06 22:30:34 user nova-compute[75000]:         <nova:port uuid="f6cb1907-7cf4-46fd-9526-9c885c806ce2">
Nov 06 22:30:34 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 22:30:34 user nova-compute[75000]:         </nova:port>
Nov 06 22:30:34 user nova-compute[75000]:       </nova:ports>
Nov 06 22:30:34 user nova-compute[75000]:     </nova:instance>
Nov 06 22:30:34 user nova-compute[75000]:   </metadata>
Nov 06 22:30:34 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:30:34 user nova-compute[75000]:     <system>
Nov 06 22:30:34 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:30:34 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:30:34 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:30:34 user nova-compute[75000]:       <entry name="serial">846bf5e2-230c-419c-be77-982acc036b40</entry>
Nov 06 22:30:34 user nova-compute[75000]:       <entry name="uuid">846bf5e2-230c-419c-be77-982acc036b40</entry>
Nov 06 22:30:34 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:30:34 user nova-compute[75000]:     </system>
Nov 06 22:30:34 user nova-compute[75000]:   </sysinfo>
Nov 06 22:30:34 user nova-compute[75000]:   <os>
Nov 06 22:30:34 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:30:34 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:30:34 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:30:34 user nova-compute[75000]:   </os>
Nov 06 22:30:34 user nova-compute[75000]:   <features>
Nov 06 22:30:34 user nova-compute[75000]:     <acpi/>
Nov 06 22:30:34 user nova-compute[75000]:     <apic/>
Nov 06 22:30:34 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:30:34 user nova-compute[75000]:   </features>
Nov 06 22:30:34 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:30:34 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:30:34 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:30:34 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:30:34 user nova-compute[75000]:   </clock>
Nov 06 22:30:34 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:30:34 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:30:34 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:30:34 user nova-compute[75000]:   </cpu>
Nov 06 22:30:34 user nova-compute[75000]:   <devices>
Nov 06 22:30:34 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:30:34 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:30:34 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk"/>
Nov 06 22:30:34 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:30:34 user nova-compute[75000]:     </disk>
Nov 06 22:30:34 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:30:34 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:30:34 user nova-compute[75000]:       <source dev="/dev/sdd"/>
Nov 06 22:30:34 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:30:34 user nova-compute[75000]:       <serial>b12a60c7-2bb6-4f35-84f2-a15588cc9e8e</serial>
Nov 06 22:30:34 user nova-compute[75000]:     </disk>
Nov 06 22:30:34 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:30:34 user nova-compute[75000]:       <mac address="fa:16:3e:4f:6d:94"/>
Nov 06 22:30:34 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:30:34 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:30:34 user nova-compute[75000]:       <target dev="tapf6cb1907-7c"/>
Nov 06 22:30:34 user nova-compute[75000]:     </interface>
Nov 06 22:30:34 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:30:34 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/console.log" append="off"/>
Nov 06 22:30:34 user nova-compute[75000]:     </serial>
Nov 06 22:30:34 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:30:34 user nova-compute[75000]:     <video>
Nov 06 22:30:34 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:30:34 user nova-compute[75000]:     </video>
Nov 06 22:30:34 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:30:34 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:30:34 user nova-compute[75000]:     </rng>
Nov 06 22:30:34 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:30:34 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:30:34 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:30:34 user nova-compute[75000]:     </memballoon>
Nov 06 22:30:34 user nova-compute[75000]:   </devices>
Nov 06 22:30:34 user nova-compute[75000]: </domain>
Nov 06 22:30:34 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-410044661',display_name='tempest-ServerActionsTestOtherB-server-410044661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-410044661',id=6,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN127j9rMCzJhcsyMMnA9oMyDSW626YDveQjSPb2IR7mcffJ8blZhWvgtIPRXJ9KDmmNRktgeSU8SDicFRInDOK2YoxINbUZ+i2iHac2q1b7ra/rMkxI3W72lm49ZRgf7w==',key_name='tempest-keypair-1677332467',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:25:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54eb33cd621c4fa78fead18be74916ee',ramdisk_id='',reservation_id='r-nlmmujhg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-408033839',owner_user_name='tempest-ServerActionsTestOtherB-408033839-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8b116c4cb154ce0a1a80045258cd123',uuid=846bf5e2-230c-419c-be77-982acc036b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-651500099-network", "vif_mac": "fa:16:3e:4f:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converting VIF {"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-651500099-network", "vif_mac": "fa:16:3e:4f:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG os_vif [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fc03e8f-ec08-5990-a9eb-0217578c15b2', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6cb1907-7c, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6cb1907-7c, col_values=(('qos', UUID('b41603a3-f85d-44dc-9d15-c8331d602864')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6cb1907-7c, col_values=(('external_ids', {'iface-id': 'f6cb1907-7cf4-46fd-9526-9c885c806ce2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:6d:94', 'vm-uuid': '846bf5e2-230c-419c-be77-982acc036b40'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:34 user nova-compute[75000]: INFO os_vif [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c')
Nov 06 22:30:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] No VIF found with MAC fa:16:3e:4f:6d:94, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-842a3c80-c605-49d0-a3f4-36c382ba2424 req-0590584d-7e28-4565-a889-ce8e18220d5d service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-842a3c80-c605-49d0-a3f4-36c382ba2424 req-0590584d-7e28-4565-a889-ce8e18220d5d service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-842a3c80-c605-49d0-a3f4-36c382ba2424 req-0590584d-7e28-4565-a889-ce8e18220d5d service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-842a3c80-c605-49d0-a3f4-36c382ba2424 req-0590584d-7e28-4565-a889-ce8e18220d5d service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-842a3c80-c605-49d0-a3f4-36c382ba2424 req-0590584d-7e28-4565-a889-ce8e18220d5d service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:39 user nova-compute[75000]: WARNING nova.compute.manager [req-842a3c80-c605-49d0-a3f4-36c382ba2424 req-0590584d-7e28-4565-a889-ce8e18220d5d service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state active and task_state resize_finish.
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-ddf8158e-cb5a-498d-959e-6ade3d446c93 req-e3d94849-e11f-4ab1-870b-8ddcf4932c81 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ddf8158e-cb5a-498d-959e-6ade3d446c93 req-e3d94849-e11f-4ab1-870b-8ddcf4932c81 service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ddf8158e-cb5a-498d-959e-6ade3d446c93 req-e3d94849-e11f-4ab1-870b-8ddcf4932c81 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ddf8158e-cb5a-498d-959e-6ade3d446c93 req-e3d94849-e11f-4ab1-870b-8ddcf4932c81 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-ddf8158e-cb5a-498d-959e-6ade3d446c93 req-e3d94849-e11f-4ab1-870b-8ddcf4932c81 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:30:39 user nova-compute[75000]: WARNING nova.compute.manager [req-ddf8158e-cb5a-498d-959e-6ade3d446c93 req-e3d94849-e11f-4ab1-870b-8ddcf4932c81 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state active and task_state resize_finish.
Nov 06 22:30:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7892MB free_disk=25.26565170288086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:30:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance running successfully.
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Failed to set time: agent not configured {{(pid=75000) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fe705b31-53df-4a0e-b1fa-e3f90c0dec35 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] finish_migration finished successfully. {{(pid=75000) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Applying migration context for instance 846bf5e2-230c-419c-be77-982acc036b40 as it has an incoming, in-progress migration de7322ef-e0f7-48fc-be65-bc1fc3f4385c. Migration status is post-migrating {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 22:30:39 user nova-compute[75000]: INFO nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating resource usage from migration de7322ef-e0f7-48fc-be65-bc1fc3f4385c
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 846bf5e2-230c-419c-be77-982acc036b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Migration de7322ef-e0f7-48fc-be65-bc1fc3f4385c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance a5f0aa50-4652-4cc3-9e59-899d32567a18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c9422249-ff7a-455e-87e1-bdce3e0345f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:40 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:30:40 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:30:40 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:30:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.808s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:30:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:30:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:30:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:30:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:30:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:30:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:30:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:54 user nova-compute[75000]: INFO nova.virt.block_device [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Booting with volume 4359b8e6-705d-4b18-a7b2-96b65ca06809 at /dev/vdc
Nov 06 22:30:54 user nova-compute[75000]: DEBUG os_brick.utils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ed4109-28f9-4710-83a7-30d29c149346]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bbc198-ace8-4497-8e19-d09f4e8e8736]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7c35c6-4dbc-42c0-9ba3-2113dcd262db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d706ea6-8a00-4a94-833c-e35b113ace34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:30:54 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:30:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e72fed-7d5d-4dd7-975d-cdbb64984796]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG os_brick.utils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating existing volume attachment record: b350531b-04f1-4ab4-8ee2-7eaf9897b11b {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:30:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:31:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:04 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:31:04 user nova-compute[75000]: INFO nova.compute.claims [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Claim successful on node user
Nov 06 22:31:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:31:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:31:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG nova.policy [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89f94a3ce27c483fabb4a3bcf053f141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f8a74b2de48a69627c6fc564d023f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:31:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Creating image(s)
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "/opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "/opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "/opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk 1073741824" returned: 0 in 0.060s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Cannot resize image /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Ensure instance console log exists: /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Successfully created port: 23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:31:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Successfully updated port: 23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "refresh_cache-0414d03a-aba0-44df-9cca-257ab81bde61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquired lock "refresh_cache-0414d03a-aba0-44df-9cca-257ab81bde61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-8ad769fd-7cf0-413a-86a2-f8e99f63cd12 req-b0bc71d7-b07c-434e-85e4-9a42c31a272c service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received event network-changed-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-8ad769fd-7cf0-413a-86a2-f8e99f63cd12 req-b0bc71d7-b07c-434e-85e4-9a42c31a272c service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Refreshing instance network info cache due to event network-changed-23d18ab8-4f29-4708-87c9-a59ce954842b. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8ad769fd-7cf0-413a-86a2-f8e99f63cd12 req-b0bc71d7-b07c-434e-85e4-9a42c31a272c service nova] Acquiring lock "refresh_cache-0414d03a-aba0-44df-9cca-257ab81bde61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Updating instance_info_cache with network_info: [{"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Releasing lock "refresh_cache-0414d03a-aba0-44df-9cca-257ab81bde61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Instance network_info: |[{"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8ad769fd-7cf0-413a-86a2-f8e99f63cd12 req-b0bc71d7-b07c-434e-85e4-9a42c31a272c service nova] Acquired lock "refresh_cache-0414d03a-aba0-44df-9cca-257ab81bde61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-8ad769fd-7cf0-413a-86a2-f8e99f63cd12 req-b0bc71d7-b07c-434e-85e4-9a42c31a272c service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Refreshing network info cache for port 23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Start _get_guest_xml network_info=[{"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:31:08 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:31:08 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1466710765',display_name='tempest-VolumesAdminNegativeTest-server-1466710765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1466710765',id=17,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrGX8tG3p9W9zGWSEs9zG0jHwTfIA/HNN4ZMpvcNsHCx9hKf4YgFI7paE0lVIdB4qc1GcdcfeT2kcODfDd5VPpjS6emiEROsJx+ZrT+tGodvse3mtYHR6Npb0bMNCeONg==',key_name='tempest-keypair-1231136319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='121f8a74b2de48a69627c6fc564d023f',ramdisk_id='',reservation_id='r-dct5doul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1947874717',owner_user_name='tempest-VolumesAdminNegativeTest-1947874717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f94a3ce27c483fabb4a3bcf053f141',uuid=0414d03a-aba0-44df-9cca-257ab81bde61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converting VIF {"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=23d18ab8-4f29-4708-87c9-a59ce954842b,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d18ab8-4f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.objects.instance [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lazy-loading 'pci_devices' on Instance uuid 0414d03a-aba0-44df-9cca-257ab81bde61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:31:08 user nova-compute[75000]:   <uuid>0414d03a-aba0-44df-9cca-257ab81bde61</uuid>
Nov 06 22:31:08 user nova-compute[75000]:   <name>instance-00000011</name>
Nov 06 22:31:08 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:31:08 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:31:08 user nova-compute[75000]:   <metadata>
Nov 06 22:31:08 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:31:08 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:31:08 user nova-compute[75000]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1466710765</nova:name>
Nov 06 22:31:08 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:31:08</nova:creationTime>
Nov 06 22:31:08 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:31:08 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:31:08 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:31:08 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:31:08 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:31:08 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:31:08 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:31:08 user nova-compute[75000]:       <nova:owner>
Nov 06 22:31:08 user nova-compute[75000]:         <nova:user uuid="89f94a3ce27c483fabb4a3bcf053f141">tempest-VolumesAdminNegativeTest-1947874717-project-member</nova:user>
Nov 06 22:31:08 user nova-compute[75000]:         <nova:project uuid="121f8a74b2de48a69627c6fc564d023f">tempest-VolumesAdminNegativeTest-1947874717</nova:project>
Nov 06 22:31:08 user nova-compute[75000]:       </nova:owner>
Nov 06 22:31:08 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:31:08 user nova-compute[75000]:       <nova:ports>
Nov 06 22:31:08 user nova-compute[75000]:         <nova:port uuid="23d18ab8-4f29-4708-87c9-a59ce954842b">
Nov 06 22:31:08 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:31:08 user nova-compute[75000]:         </nova:port>
Nov 06 22:31:08 user nova-compute[75000]:       </nova:ports>
Nov 06 22:31:08 user nova-compute[75000]:     </nova:instance>
Nov 06 22:31:08 user nova-compute[75000]:   </metadata>
Nov 06 22:31:08 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:31:08 user nova-compute[75000]:     <system>
Nov 06 22:31:08 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:31:08 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:31:08 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:31:08 user nova-compute[75000]:       <entry name="serial">0414d03a-aba0-44df-9cca-257ab81bde61</entry>
Nov 06 22:31:08 user nova-compute[75000]:       <entry name="uuid">0414d03a-aba0-44df-9cca-257ab81bde61</entry>
Nov 06 22:31:08 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:31:08 user nova-compute[75000]:     </system>
Nov 06 22:31:08 user nova-compute[75000]:   </sysinfo>
Nov 06 22:31:08 user nova-compute[75000]:   <os>
Nov 06 22:31:08 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:31:08 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:31:08 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:31:08 user nova-compute[75000]:   </os>
Nov 06 22:31:08 user nova-compute[75000]:   <features>
Nov 06 22:31:08 user nova-compute[75000]:     <acpi/>
Nov 06 22:31:08 user nova-compute[75000]:     <apic/>
Nov 06 22:31:08 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:31:08 user nova-compute[75000]:   </features>
Nov 06 22:31:08 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:31:08 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:31:08 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:31:08 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:31:08 user nova-compute[75000]:   </clock>
Nov 06 22:31:08 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:31:08 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:31:08 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:31:08 user nova-compute[75000]:   </cpu>
Nov 06 22:31:08 user nova-compute[75000]:   <devices>
Nov 06 22:31:08 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:31:08 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:31:08 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk"/>
Nov 06 22:31:08 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:31:08 user nova-compute[75000]:     </disk>
Nov 06 22:31:08 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:31:08 user nova-compute[75000]:       <mac address="fa:16:3e:5d:6a:0d"/>
Nov 06 22:31:08 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:08 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:31:08 user nova-compute[75000]:       <target dev="tap23d18ab8-4f"/>
Nov 06 22:31:08 user nova-compute[75000]:     </interface>
Nov 06 22:31:08 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:31:08 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/console.log" append="off"/>
Nov 06 22:31:08 user nova-compute[75000]:     </serial>
Nov 06 22:31:08 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:31:08 user nova-compute[75000]:     <video>
Nov 06 22:31:08 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:08 user nova-compute[75000]:     </video>
Nov 06 22:31:08 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:31:08 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:31:08 user nova-compute[75000]:     </rng>
Nov 06 22:31:08 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:31:08 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:31:08 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:31:08 user nova-compute[75000]:     </memballoon>
Nov 06 22:31:08 user nova-compute[75000]:   </devices>
Nov 06 22:31:08 user nova-compute[75000]: </domain>
Nov 06 22:31:08 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1466710765',display_name='tempest-VolumesAdminNegativeTest-server-1466710765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1466710765',id=17,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrGX8tG3p9W9zGWSEs9zG0jHwTfIA/HNN4ZMpvcNsHCx9hKf4YgFI7paE0lVIdB4qc1GcdcfeT2kcODfDd5VPpjS6emiEROsJx+ZrT+tGodvse3mtYHR6Npb0bMNCeONg==',key_name='tempest-keypair-1231136319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='121f8a74b2de48a69627c6fc564d023f',ramdisk_id='',reservation_id='r-dct5doul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1947874717',owner_user_name='tempest-VolumesAdminNegativeTest-1947874717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f94a3ce27c483fabb4a3bcf053f141',uuid=0414d03a-aba0-44df-9cca-257ab81bde61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converting VIF {"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=23d18ab8-4f29-4708-87c9-a59ce954842b,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d18ab8-4f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG os_vif [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=23d18ab8-4f29-4708-87c9-a59ce954842b,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d18ab8-4f') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b13071ab-3a0e-56a5-ac49-50ac06ebfab6', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23d18ab8-4f, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23d18ab8-4f, col_values=(('qos', UUID('09f85c73-c791-45fa-8a74-21e9d0234940')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23d18ab8-4f, col_values=(('external_ids', {'iface-id': '23d18ab8-4f29-4708-87c9-a59ce954842b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:6a:0d', 'vm-uuid': '0414d03a-aba0-44df-9cca-257ab81bde61'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:08 user nova-compute[75000]: INFO os_vif [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=23d18ab8-4f29-4708-87c9-a59ce954842b,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d18ab8-4f')
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] No VIF found with MAC fa:16:3e:5d:6a:0d, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-8ad769fd-7cf0-413a-86a2-f8e99f63cd12 req-b0bc71d7-b07c-434e-85e4-9a42c31a272c service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Updated VIF entry in instance network info cache for port 23d18ab8-4f29-4708-87c9-a59ce954842b. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-8ad769fd-7cf0-413a-86a2-f8e99f63cd12 req-b0bc71d7-b07c-434e-85e4-9a42c31a272c service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Updating instance_info_cache with network_info: [{"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8ad769fd-7cf0-413a-86a2-f8e99f63cd12 req-b0bc71d7-b07c-434e-85e4-9a42c31a272c service nova] Releasing lock "refresh_cache-0414d03a-aba0-44df-9cca-257ab81bde61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:31:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:09 user nova-compute[75000]: DEBUG nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:31:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:09 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:31:09 user nova-compute[75000]: INFO nova.compute.claims [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Claim successful on node user
Nov 06 22:31:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.network.neutron [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:31:10 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.policy [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afc6c795f94d4469825b1ceac5bb2ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f0e789571a4a63b90b26c9a5b0c954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:31:10 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Creating image(s)
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "/opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "/opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "/opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:10 user nova-compute[75000]: INFO nova.compute.manager [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Terminating instance
Nov 06 22:31:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk 1073741824" returned: 0 in 0.085s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.network.neutron [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Successfully created port: 7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-5db0d820-c066-44b8-b40a-0f6bb316e9ad req-54474dd8-d059-49ba-86af-dc748b44b7c8 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received event network-vif-unplugged-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5db0d820-c066-44b8-b40a-0f6bb316e9ad req-54474dd8-d059-49ba-86af-dc748b44b7c8 service nova] Acquiring lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5db0d820-c066-44b8-b40a-0f6bb316e9ad req-54474dd8-d059-49ba-86af-dc748b44b7c8 service nova] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5db0d820-c066-44b8-b40a-0f6bb316e9ad req-54474dd8-d059-49ba-86af-dc748b44b7c8 service nova] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-5db0d820-c066-44b8-b40a-0f6bb316e9ad req-54474dd8-d059-49ba-86af-dc748b44b7c8 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] No waiting events found dispatching network-vif-unplugged-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-5db0d820-c066-44b8-b40a-0f6bb316e9ad req-54474dd8-d059-49ba-86af-dc748b44b7c8 service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received event network-vif-unplugged-735dc42c-6666-426a-9739-2b1438b07175 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Cannot resize image /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Ensure instance console log exists: /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Instance destroyed successfully.
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.objects.instance [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lazy-loading 'resources' on Instance uuid a5f0aa50-4652-4cc3-9e59-899d32567a18 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1721160334',display_name='tempest-TestVolumeSwap-server-1721160334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1721160334',id=7,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOhHCh6EJb7OnBC7GQhKg9G4IKIXr77LC8RniYpFCba/PnqnwNETCmE/aSE5+5sc1+naYOJMxdKVa8piEZCUHGcMCjqO0PISAhlg90s0SDOs5S387En0IRzTlKSt6i15Q==',key_name='tempest-keypair-867183940',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:26:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='781066e62dae49f786a6125637de0711',ramdisk_id='',reservation_id='r-i6d0u06e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1693318627',owner_user_name='tempest-TestVolumeSwap-1693318627-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb8b6cf0a5ff4e378b0b5e82360e6f4c',uuid=a5f0aa50-4652-4cc3-9e59-899d32567a18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Converting VIF {"id": "735dc42c-6666-426a-9739-2b1438b07175", "address": "fa:16:3e:24:dc:d0", "network": {"id": "e7f14970-b18e-43c3-bbf9-0675704763ff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-232005898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "781066e62dae49f786a6125637de0711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735dc42c-66", "ovs_interfaceid": "735dc42c-6666-426a-9739-2b1438b07175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:dc:d0,bridge_name='br-int',has_traffic_filtering=True,id=735dc42c-6666-426a-9739-2b1438b07175,network=Network(e7f14970-b18e-43c3-bbf9-0675704763ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735dc42c-66') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG os_vif [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:dc:d0,bridge_name='br-int',has_traffic_filtering=True,id=735dc42c-6666-426a-9739-2b1438b07175,network=Network(e7f14970-b18e-43c3-bbf9-0675704763ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735dc42c-66') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap735dc42c-66, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24200024-f0d8-406d-912c-287087361f57) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:11 user nova-compute[75000]: INFO os_vif [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:dc:d0,bridge_name='br-int',has_traffic_filtering=True,id=735dc42c-6666-426a-9739-2b1438b07175,network=Network(e7f14970-b18e-43c3-bbf9-0675704763ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735dc42c-66')
Nov 06 22:31:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Deleting instance files /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18_del
Nov 06 22:31:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Deletion of /opt/stack/data/nova/instances/a5f0aa50-4652-4cc3-9e59-899d32567a18_del complete
Nov 06 22:31:11 user nova-compute[75000]: INFO nova.compute.manager [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 22:31:11 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:31:11 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Successfully updated port: 7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "refresh_cache-a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquired lock "refresh_cache-a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:31:12 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Instance spawned successfully.
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:12 user nova-compute[75000]: INFO nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Took 7.09 seconds to spawn the instance on the hypervisor.
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:31:12 user nova-compute[75000]: INFO nova.compute.manager [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Took 7.99 seconds to build instance.
Nov 06 22:31:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6a0c6238-2e30-49b3-ab65-b661dd84785a tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.097s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Updating instance_info_cache with network_info: [{"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Releasing lock "refresh_cache-a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Instance network_info: |[{"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Start _get_guest_xml network_info=[{"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:31:12 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:31:12 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:31:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1594553101',display_name='tempest-VolumesActionsTest-instance-1594553101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1594553101',id=18,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8f0e789571a4a63b90b26c9a5b0c954',ramdisk_id='',reservation_id='r-urmhkc1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-297854992',owner_user_name='tempest-VolumesActionsTest-297854992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:31:11Z,user_data=None,user_id='afc6c795f94d4469825b1ceac5bb2ccb',uuid=a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converting VIF {"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:12:51,bridge_name='br-int',has_traffic_filtering=True,id=7e1bca9c-0bae-4e25-a63e-444758f9569b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1bca9c-0b') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.objects.instance [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lazy-loading 'pci_devices' on Instance uuid a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:31:13 user nova-compute[75000]:   <uuid>a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff</uuid>
Nov 06 22:31:13 user nova-compute[75000]:   <name>instance-00000012</name>
Nov 06 22:31:13 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:31:13 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:31:13 user nova-compute[75000]:   <metadata>
Nov 06 22:31:13 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:31:13 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:31:13 user nova-compute[75000]:       <nova:name>tempest-VolumesActionsTest-instance-1594553101</nova:name>
Nov 06 22:31:13 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:31:12</nova:creationTime>
Nov 06 22:31:13 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:31:13 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:31:13 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:31:13 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:31:13 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:31:13 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:31:13 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:31:13 user nova-compute[75000]:       <nova:owner>
Nov 06 22:31:13 user nova-compute[75000]:         <nova:user uuid="afc6c795f94d4469825b1ceac5bb2ccb">tempest-VolumesActionsTest-297854992-project-member</nova:user>
Nov 06 22:31:13 user nova-compute[75000]:         <nova:project uuid="a8f0e789571a4a63b90b26c9a5b0c954">tempest-VolumesActionsTest-297854992</nova:project>
Nov 06 22:31:13 user nova-compute[75000]:       </nova:owner>
Nov 06 22:31:13 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:31:13 user nova-compute[75000]:       <nova:ports>
Nov 06 22:31:13 user nova-compute[75000]:         <nova:port uuid="7e1bca9c-0bae-4e25-a63e-444758f9569b">
Nov 06 22:31:13 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:31:13 user nova-compute[75000]:         </nova:port>
Nov 06 22:31:13 user nova-compute[75000]:       </nova:ports>
Nov 06 22:31:13 user nova-compute[75000]:     </nova:instance>
Nov 06 22:31:13 user nova-compute[75000]:   </metadata>
Nov 06 22:31:13 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:31:13 user nova-compute[75000]:     <system>
Nov 06 22:31:13 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:31:13 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:31:13 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:31:13 user nova-compute[75000]:       <entry name="serial">a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff</entry>
Nov 06 22:31:13 user nova-compute[75000]:       <entry name="uuid">a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff</entry>
Nov 06 22:31:13 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:31:13 user nova-compute[75000]:     </system>
Nov 06 22:31:13 user nova-compute[75000]:   </sysinfo>
Nov 06 22:31:13 user nova-compute[75000]:   <os>
Nov 06 22:31:13 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:31:13 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:31:13 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:31:13 user nova-compute[75000]:   </os>
Nov 06 22:31:13 user nova-compute[75000]:   <features>
Nov 06 22:31:13 user nova-compute[75000]:     <acpi/>
Nov 06 22:31:13 user nova-compute[75000]:     <apic/>
Nov 06 22:31:13 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:31:13 user nova-compute[75000]:   </features>
Nov 06 22:31:13 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:31:13 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:31:13 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:31:13 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:31:13 user nova-compute[75000]:   </clock>
Nov 06 22:31:13 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:31:13 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:31:13 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:31:13 user nova-compute[75000]:   </cpu>
Nov 06 22:31:13 user nova-compute[75000]:   <devices>
Nov 06 22:31:13 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:31:13 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:31:13 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk"/>
Nov 06 22:31:13 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:31:13 user nova-compute[75000]:     </disk>
Nov 06 22:31:13 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:31:13 user nova-compute[75000]:       <mac address="fa:16:3e:ff:12:51"/>
Nov 06 22:31:13 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:13 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:31:13 user nova-compute[75000]:       <target dev="tap7e1bca9c-0b"/>
Nov 06 22:31:13 user nova-compute[75000]:     </interface>
Nov 06 22:31:13 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:31:13 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/console.log" append="off"/>
Nov 06 22:31:13 user nova-compute[75000]:     </serial>
Nov 06 22:31:13 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:31:13 user nova-compute[75000]:     <video>
Nov 06 22:31:13 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:13 user nova-compute[75000]:     </video>
Nov 06 22:31:13 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:31:13 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:31:13 user nova-compute[75000]:     </rng>
Nov 06 22:31:13 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:31:13 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:31:13 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:31:13 user nova-compute[75000]:     </memballoon>
Nov 06 22:31:13 user nova-compute[75000]:   </devices>
Nov 06 22:31:13 user nova-compute[75000]: </domain>
Nov 06 22:31:13 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1594553101',display_name='tempest-VolumesActionsTest-instance-1594553101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1594553101',id=18,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8f0e789571a4a63b90b26c9a5b0c954',ramdisk_id='',reservation_id='r-urmhkc1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-297854992',owner_user_name='tempest-VolumesActionsTest-297854992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:31:11Z,user_data=None,user_id='afc6c795f94d4469825b1ceac5bb2ccb',uuid=a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converting VIF {"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:12:51,bridge_name='br-int',has_traffic_filtering=True,id=7e1bca9c-0bae-4e25-a63e-444758f9569b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1bca9c-0b') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG os_vif [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:12:51,bridge_name='br-int',has_traffic_filtering=True,id=7e1bca9c-0bae-4e25-a63e-444758f9569b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1bca9c-0b') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c793f6f8-eb7b-5d3c-8cc5-4077a525b3f6', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e1bca9c-0b, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e1bca9c-0b, col_values=(('qos', UUID('6cbb289a-cf2d-4966-a96c-2cbd51e9d0b4')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e1bca9c-0b, col_values=(('external_ids', {'iface-id': '7e1bca9c-0bae-4e25-a63e-444758f9569b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:12:51', 'vm-uuid': 'a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:13 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Took 1.16 seconds to deallocate network for instance.
Nov 06 22:31:13 user nova-compute[75000]: INFO os_vif [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:12:51,bridge_name='br-int',has_traffic_filtering=True,id=7e1bca9c-0bae-4e25-a63e-444758f9569b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1bca9c-0b')
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] No VIF found with MAC fa:16:3e:ff:12:51, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received event network-vif-plugged-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] Acquiring lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] No waiting events found dispatching network-vif-plugged-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:13 user nova-compute[75000]: WARNING nova.compute.manager [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received unexpected event network-vif-plugged-735dc42c-6666-426a-9739-2b1438b07175 for instance with vm_state deleted and task_state None.
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received event network-changed-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Refreshing instance network info cache due to event network-changed-7e1bca9c-0bae-4e25-a63e-444758f9569b. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] Acquiring lock "refresh_cache-a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] Acquired lock "refresh_cache-a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.network.neutron [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Refreshing network info cache for port 7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:31:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.652s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:13 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Deleted allocations for instance a5f0aa50-4652-4cc3-9e59-899d32567a18
Nov 06 22:31:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dc662172-9a92-4044-9850-e12f97a3e9f0 tempest-TestVolumeSwap-1693318627 tempest-TestVolumeSwap-1693318627-project-member] Lock "a5f0aa50-4652-4cc3-9e59-899d32567a18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.013s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Updated VIF entry in instance network info cache for port 7e1bca9c-0bae-4e25-a63e-444758f9569b. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:31:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Updating instance_info_cache with network_info: [{"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] Releasing lock "refresh_cache-a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:31:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-b58e72d4-c918-4b74-a914-bbea8e6fee22 req-c83c50cd-d4bf-4466-ae52-894bd5c73a4f service nova] [instance: a5f0aa50-4652-4cc3-9e59-899d32567a18] Received event network-vif-deleted-735dc42c-6666-426a-9739-2b1438b07175 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-2dc57443-ab4a-41b4-a1a6-c6148b61d984 req-c5090eb7-2fa7-4b02-a8f9-3031aba0837c service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-changed-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-2dc57443-ab4a-41b4-a1a6-c6148b61d984 req-c5090eb7-2fa7-4b02-a8f9-3031aba0837c service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Refreshing instance network info cache due to event network-changed-884e3b6b-4f31-4776-9d5c-b8f64388f438. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2dc57443-ab4a-41b4-a1a6-c6148b61d984 req-c5090eb7-2fa7-4b02-a8f9-3031aba0837c service nova] Acquiring lock "refresh_cache-4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2dc57443-ab4a-41b4-a1a6-c6148b61d984 req-c5090eb7-2fa7-4b02-a8f9-3031aba0837c service nova] Acquired lock "refresh_cache-4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG nova.network.neutron [req-2dc57443-ab4a-41b4-a1a6-c6148b61d984 req-c5090eb7-2fa7-4b02-a8f9-3031aba0837c service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Refreshing network info cache for port 884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'flavor' on Instance uuid 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:31:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:16 user nova-compute[75000]: INFO nova.compute.manager [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Attaching volume 076b8cb3-faf6-4575-8f2c-a938527eb6f4 to /dev/vdb
Nov 06 22:31:16 user nova-compute[75000]: DEBUG os_brick.utils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[750104bf-e859-4325-a7e0-049b14785ff7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30acd45-79fa-4f88-893b-e30ea9cf1c1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a6f22a-7c54-47ec-8594-248352bdbc2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9485076e-47b7-47aa-bec1-a01c5929409d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-2dc57443-ab4a-41b4-a1a6-c6148b61d984 req-c5090eb7-2fa7-4b02-a8f9-3031aba0837c service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Updated VIF entry in instance network info cache for port 884e3b6b-4f31-4776-9d5c-b8f64388f438. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-2dc57443-ab4a-41b4-a1a6-c6148b61d984 req-c5090eb7-2fa7-4b02-a8f9-3031aba0837c service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Updating instance_info_cache with network_info: [{"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:31:16 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6605593b-213e-4ec7-8763-59c7030e35a6]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG os_brick.utils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Updating existing volume attachment record: 98bc4408-28a3-473d-b2ea-fb706bdd588e {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2dc57443-ab4a-41b4-a1a6-c6148b61d984 req-c5090eb7-2fa7-4b02-a8f9-3031aba0837c service nova] Releasing lock "refresh_cache-4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-067e5709-3125-47c2-b76f-b6c79d2a6b1c req-04e060d7-7400-4bc6-a489-ad08b138d8ad service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received event network-vif-plugged-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-067e5709-3125-47c2-b76f-b6c79d2a6b1c req-04e060d7-7400-4bc6-a489-ad08b138d8ad service nova] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-067e5709-3125-47c2-b76f-b6c79d2a6b1c req-04e060d7-7400-4bc6-a489-ad08b138d8ad service nova] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-067e5709-3125-47c2-b76f-b6c79d2a6b1c req-04e060d7-7400-4bc6-a489-ad08b138d8ad service nova] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-067e5709-3125-47c2-b76f-b6c79d2a6b1c req-04e060d7-7400-4bc6-a489-ad08b138d8ad service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] No waiting events found dispatching network-vif-plugged-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:16 user nova-compute[75000]: WARNING nova.compute.manager [req-067e5709-3125-47c2-b76f-b6c79d2a6b1c req-04e060d7-7400-4bc6-a489-ad08b138d8ad service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received unexpected event network-vif-plugged-23d18ab8-4f29-4708-87c9-a59ce954842b for instance with vm_state active and task_state None.
Nov 06 22:31:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:31:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Instance spawned successfully.
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:17 user nova-compute[75000]: INFO nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 06 22:31:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:31:17 user nova-compute[75000]: INFO nova.compute.manager [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Took 7.73 seconds to build instance.
Nov 06 22:31:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-39262836-b1e0-4ea5-a475-ebf234e7dda8 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.843s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received event network-vif-plugged-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] No waiting events found dispatching network-vif-plugged-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:18 user nova-compute[75000]: WARNING nova.compute.manager [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received unexpected event network-vif-plugged-23d18ab8-4f29-4708-87c9-a59ce954842b for instance with vm_state active and task_state None.
Nov 06 22:31:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received event network-vif-plugged-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] Acquiring lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] No waiting events found dispatching network-vif-plugged-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:18 user nova-compute[75000]: WARNING nova.compute.manager [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received unexpected event network-vif-plugged-7e1bca9c-0bae-4e25-a63e-444758f9569b for instance with vm_state active and task_state None.
Nov 06 22:31:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received event network-vif-plugged-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] Acquiring lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] No waiting events found dispatching network-vif-plugged-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:18 user nova-compute[75000]: WARNING nova.compute.manager [req-42345507-9172-4be5-9f3e-c8cf70dd2fea req-8759403d-5812-4ba4-87ff-74a8c1a61edb service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received unexpected event network-vif-plugged-7e1bca9c-0bae-4e25-a63e-444758f9569b for instance with vm_state active and task_state None.
Nov 06 22:31:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:22 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 22:31:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 22:31:22 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 22:31:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:23 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:26 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:26 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:31 user nova-compute[75000]: INFO nova.compute.manager [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Terminating instance
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:31:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-d65c9479-18a4-4a3f-97dc-22243154b636 req-bb7c808b-06cb-4922-98c1-48845e424fcb service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-unplugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d65c9479-18a4-4a3f-97dc-22243154b636 req-bb7c808b-06cb-4922-98c1-48845e424fcb service nova] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d65c9479-18a4-4a3f-97dc-22243154b636 req-bb7c808b-06cb-4922-98c1-48845e424fcb service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d65c9479-18a4-4a3f-97dc-22243154b636 req-bb7c808b-06cb-4922-98c1-48845e424fcb service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-d65c9479-18a4-4a3f-97dc-22243154b636 req-bb7c808b-06cb-4922-98c1-48845e424fcb service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] No waiting events found dispatching network-vif-unplugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-d65c9479-18a4-4a3f-97dc-22243154b636 req-bb7c808b-06cb-4922-98c1-48845e424fcb service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-unplugged-86811d4a-20c1-4f36-898c-20b19c608073 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Instance destroyed successfully.
Nov 06 22:31:32 user nova-compute[75000]: DEBUG nova.objects.instance [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lazy-loading 'resources' on Instance uuid 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1899715161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-974537480',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIby10utLlq64C+H0w0t6/RnIbsoLKrjjLWjuvHWYi0jYgcp6Sn19ciLh/GKqFYOykP4dfqlAYpSrwPN1t6AKylbp6fz517kU3tDTAViFlqnXC1l3fJO2sS1jDfUR8d4fg==',key_name='tempest-keypair-317477647',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:29:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9a1f61a8a6d4239ac6c506f63cc68d2',ramdisk_id='',reservation_id='r-l4y2605r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-181120062',owner_user_name='tempest-ServerActionsV293TestJSON-181120062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:29:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f689ecfaa97f410b9ceea5760631957c',uuid=0991271f-2087-4e6a-8fa7-fe29ddfa8ed7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converting VIF {"id": "86811d4a-20c1-4f36-898c-20b19c608073", "address": "fa:16:3e:84:76:b5", "network": {"id": "7bdd703e-20de-4d50-9ccc-8a926e64fd8e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-754330578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9a1f61a8a6d4239ac6c506f63cc68d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86811d4a-20", "ovs_interfaceid": "86811d4a-20c1-4f36-898c-20b19c608073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_vif [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86811d4a-20, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95ee4cb8-a6d6-418b-89f9-4243fa37ad40) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:32 user nova-compute[75000]: INFO os_vif [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:76:b5,bridge_name='br-int',has_traffic_filtering=True,id=86811d4a-20c1-4f36-898c-20b19c608073,network=Network(7bdd703e-20de-4d50-9ccc-8a926e64fd8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86811d4a-20')
Nov 06 22:31:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSODLmeB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:32 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00cfdca-35e4-4320-83c9-c349c8dd03ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:31:32 user nova-compute[75000]: No targets found.
Nov 06 22:31:32 user nova-compute[75000]: iSNS:
Nov 06 22:31:32 user nova-compute[75000]: No targets found.
Nov 06 22:31:32 user nova-compute[75000]: STATIC:
Nov 06 22:31:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:31:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:31:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd
Nov 06 22:31:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:32 user nova-compute[75000]: FIRMWARE:
Nov 06 22:31:32 user nova-compute[75000]: No targets found.
Nov 06 22:31:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:31:32 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:31:32 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4264908-7415-4c3d-a128-821a89438478]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c9c0a2-d8dd-4c18-a58a-25af9f853dc6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:32 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:32 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:31:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:32 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:32 user nova-compute[75000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd (non-flash)
Nov 06 22:31:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc113010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7f08b0-d93d-4a27-bdf1-403d51c0c47a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a6db43-c8de-491d-bd8b-16c1d4789722]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de65e7a-27dd-4358-be57-0412a1dc5bd7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59db23b-9a42-4e81-80fd-2905dbf54c5a]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO100eaa3-8b4416d9f81bbcc6', '/dev/disk/by-id/scsi-23862343431366439', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_100eaa3') {{(pid=86571) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cbb683-3f4c-479d-845a-b11fd8a708e3]: (4, None) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e94cdb6-9c7d-4871-819d-b7b4c1639a3d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a662b-9be9-4144-90b3-f1c641587a87]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260]
Nov 06 22:31:33 user nova-compute[75000]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd, portal: 172.16.0.220,3260] successful.
Nov 06 22:31:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c9e9ace-cfb8-4470-ab04-84269ea895dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa851ab-7f84-4a83-be55-c9ac2258abc2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] <== disconnect_volume: return (408ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:31:33 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Deleting instance files /opt/stack/data/nova/instances/0991271f-2087-4e6a-8fa7-fe29ddfa8ed7_del
Nov 06 22:31:33 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Deletion of /opt/stack/data/nova/instances/0991271f-2087-4e6a-8fa7-fe29ddfa8ed7_del complete
Nov 06 22:31:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:33 user nova-compute[75000]: INFO nova.compute.manager [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Took 1.70 seconds to destroy the instance on the hypervisor.
Nov 06 22:31:33 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:31:33 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:31:33 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7216MB free_disk=25.21245574951172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Applying migration context for instance 846bf5e2-230c-419c-be77-982acc036b40 as it has an incoming, in-progress migration de7322ef-e0f7-48fc-be65-bc1fc3f4385c. Migration status is finished {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 22:31:33 user nova-compute[75000]: INFO nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating resource usage from migration de7322ef-e0f7-48fc-be65-bc1fc3f4385c
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Migration de7322ef-e0f7-48fc-be65-bc1fc3f4385c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c9422249-ff7a-455e-87e1-bdce3e0345f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 846bf5e2-230c-419c-be77-982acc036b40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0414d03a-aba0-44df-9cca-257ab81bde61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:31:33 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-38980fe1-5efd-4f44-99d6-ac9d792e3091 req-a425b61d-8138-44fd-a0e3-0461b48fd59c service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-38980fe1-5efd-4f44-99d6-ac9d792e3091 req-a425b61d-8138-44fd-a0e3-0461b48fd59c service nova] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-38980fe1-5efd-4f44-99d6-ac9d792e3091 req-a425b61d-8138-44fd-a0e3-0461b48fd59c service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-38980fe1-5efd-4f44-99d6-ac9d792e3091 req-a425b61d-8138-44fd-a0e3-0461b48fd59c service nova] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-38980fe1-5efd-4f44-99d6-ac9d792e3091 req-a425b61d-8138-44fd-a0e3-0461b48fd59c service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] No waiting events found dispatching network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:34 user nova-compute[75000]: WARNING nova.compute.manager [req-38980fe1-5efd-4f44-99d6-ac9d792e3091 req-a425b61d-8138-44fd-a0e3-0461b48fd59c service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received unexpected event network-vif-plugged-86811d4a-20c1-4f36-898c-20b19c608073 for instance with vm_state active and task_state deleting.
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.009s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:34 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Took 1.06 seconds to deallocate network for instance.
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-a1b66f29-5c48-427e-8fcd-c658d427b35b req-9e1872f2-9af0-4400-bdfc-89d3d1c9329d service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Received event network-vif-deleted-86811d4a-20c1-4f36-898c-20b19c608073 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:34 user nova-compute[75000]: INFO nova.compute.manager [req-a1b66f29-5c48-427e-8fcd-c658d427b35b req-9e1872f2-9af0-4400-bdfc-89d3d1c9329d service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Neutron deleted interface 86811d4a-20c1-4f36-898c-20b19c608073; detaching it from the instance and deleting it from the info cache
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.network.neutron [req-a1b66f29-5c48-427e-8fcd-c658d427b35b req-9e1872f2-9af0-4400-bdfc-89d3d1c9329d service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-a1b66f29-5c48-427e-8fcd-c658d427b35b req-9e1872f2-9af0-4400-bdfc-89d3d1c9329d service nova] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Detach interface failed, port_id=86811d4a-20c1-4f36-898c-20b19c608073, reason: Instance 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:31:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:35 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:35 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:31:35 user nova-compute[75000]: INFO nova.compute.manager [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Took 1.00 seconds to detach 1 volumes for instance.
Nov 06 22:31:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] [instance: 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7] Deleting volume: 4c9e9ace-cfb8-4470-ab04-84269ea895dd {{(pid=75000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 22:31:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:31:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:31:35 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:31:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance_info_cache with network_info: [{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:36 user nova-compute[75000]: WARNING nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] While synchronizing instance power states, found 12 instances in the database and 10 instances on the hypervisor.
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid bf3bafdf-dba5-4961-a891-98f522b27f53 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 97e834ec-a286-4da9-a6b8-164a1061f042 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 846bf5e2-230c-419c-be77-982acc036b40 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid c9422249-ff7a-455e-87e1-bdce3e0345f1 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 0414d03a-aba0-44df-9cca-257ab81bde61 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "97e834ec-a286-4da9-a6b8-164a1061f042" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "97e834ec-a286-4da9-a6b8-164a1061f042" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "846bf5e2-230c-419c-be77-982acc036b40" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "97e834ec-a286-4da9-a6b8-164a1061f042" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "846bf5e2-230c-419c-be77-982acc036b40" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.571s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Deleted allocations for instance 0991271f-2087-4e6a-8fa7-fe29ddfa8ed7
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-587acffd-efb4-4ebc-9af3-1e1e80ff2bbc tempest-ServerActionsV293TestJSON-181120062 tempest-ServerActionsV293TestJSON-181120062-project-member] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.672s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.287s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "0991271f-2087-4e6a-8fa7-fe29ddfa8ed7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFOKHcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:42 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:42 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:42 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[97897ae6-ed2e-4c7d-af36-56b96bc22d87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:31:42 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c366e593-9fa2-43a1-baa5-f9a3b10b26a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4] added
Nov 06 22:31:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf7d824-e6ea-40c6-b784-ef57fd7be09d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:31:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Creating image(s)
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Ensure instance console log exists: /opt/stack/data/nova/instances/c9422249-ff7a-455e-87e1-bdce3e0345f1/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Start _get_guest_xml network_info=[{"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHrMZLvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9422249-ff7a-455e-87e1-bdce3e0345f1', 'attached_at': '', 'detached_at': '', 'volume_id': '2e1fcc01-a3aa-4896-ba3f-f7509a966569', 'serial': '2e1fcc01-a3aa-4896-ba3f-f7509a966569'}, 'attachment_id': '23b686c9-931a-4c38-852d-93c135d07bb3', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdOJoHNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9422249-ff7a-455e-87e1-bdce3e0345f1', 'attached_at': '', 'detached_at': '', 'volume_id': '0883f49d-f390-4aba-8a64-388111d2b818', 'serial': '0883f49d-f390-4aba-8a64-388111d2b818'}, 'attachment_id': 'ab53337a-ad3d-4ea2-a25b-476454314eec', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJExraP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9422249-ff7a-455e-87e1-bdce3e0345f1', 'attached_at': '', 'detached_at': '', 'volume_id': '4359b8e6-705d-4b18-a7b2-96b65ca06809', 'serial': '4359b8e6-705d-4b18-a7b2-96b65ca06809'}, 'attachment_id': 'b350531b-04f1-4ab4-8ee2-7eaf9897b11b', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe6a548-b8e3-4ba1-95c2-0f3c717b935a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFOKHcSp {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:42 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:31:42 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:31:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHrMZLvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:43 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFOKHcSp" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04be715-0fbc-49a5-ba49-03c0b84f212d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aFOKHcSp'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c656077-4565-4b7a-824c-efa274bb0d79]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a4f0f4-4baa-4274-9806-9a1228549e18]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:43 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:43 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:43 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:43 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe01ca4-0a50-47e6-8b99-ac9f9fda4e33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260]
Nov 06 22:31:43 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260] successful.
Nov 06 22:31:43 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec66b4b-354e-4d4b-bc82-0c2420ae3ac2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2551ccb4-0df8-431f-814e-21129522c420]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:43 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:43 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:43 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:43 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:43 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:43 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[587324e7-da4b-4746-aee9-b7545c345938]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:43 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFOKHcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26663633037636235', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663633037636235', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.191s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:44 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:44 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'flavor' on Instance uuid 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33407ca-1803-47bc-b6b4-198a0aac0a3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:31:44 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54a43db-6d97-499b-8440-c751906ff66a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569] added
Nov 06 22:31:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:31:44 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:31:44 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:31:44 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:31:44 user nova-compute[75000]:   <serial>076b8cb3-faf6-4575-8f2c-a938527eb6f4</serial>
Nov 06 22:31:44 user nova-compute[75000]: </disk>
Nov 06 22:31:44 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f5367f-3df1-4179-b9c0-44c295a41b2a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f8048d-e7db-4b9c-934d-edccce1c9291]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHrMZLvx {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cHrMZLvx" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe2fe37-2377-4ef5-ae95-0be01a5afe0d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cHrMZLvx'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[070efd81-9067-4b7e-86b1-ad7ca2a89f85]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3222897a-9a18-4688-a384-9da5f54a050f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --login" returned: 0 in 0.214s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[470b5b77-6f76-4992-8952-4e07dd7c97e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569, portal: 172.16.0.220,3260]
Nov 06 22:31:44 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569, portal: 172.16.0.220,3260] successful.
Nov 06 22:31:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[229ab7eb-2f33-4d11-bbe8-a8a0d3ff3bdd]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a84db7-dc2d-40cb-8135-6c2057c7ad7c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5040875-3e25-41fe-a5e0-3ae9258384f7]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No VIF found with MAC fa:16:3e:c2:66:35, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:31:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8b5b17ed-d063-4815-926a-37ef1fc47325 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.909s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.768s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHrMZLvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.576s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] <== connect_volume: return (2767ms) {'type': 'block', 'scsi_wwn': '23462393364633864', 'path': '/dev/sde'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462393364633864', 'path': '/dev/sde'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdOJoHNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:45 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:45 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:45 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa3067-1517-4ddb-9e18-f6bada96410e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:31:45 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd35d90-1b27-43c0-b65a-de13117d9e5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818] added
Nov 06 22:31:45 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93022b7-98f3-432d-a740-8cddf47990f6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8113eec8-e988-437d-9deb-bb5538319e4f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdOJoHNe {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdOJoHNe" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d0646a-eb0b-47a8-8e66-57942eba50d5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XdOJoHNe'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab1feec-d542-4061-a4ef-286d389ebda5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a21b7d-5d2d-4845-a178-0c5547a7f530]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:46 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:46 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:46 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:46 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:46 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:46 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:46 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:46 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:46 user nova-compute[75000]: INFO nova.compute.manager [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Rebuilding instance
Nov 06 22:31:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-251c229e-e9ec-4050-aa66-5a6725dbd344 req-3077bb12-e047-4bad-ab86-a3a50fdd3724 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-unplugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-251c229e-e9ec-4050-aa66-5a6725dbd344 req-3077bb12-e047-4bad-ab86-a3a50fdd3724 service nova] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-251c229e-e9ec-4050-aa66-5a6725dbd344 req-3077bb12-e047-4bad-ab86-a3a50fdd3724 service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-251c229e-e9ec-4050-aa66-5a6725dbd344 req-3077bb12-e047-4bad-ab86-a3a50fdd3724 service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-251c229e-e9ec-4050-aa66-5a6725dbd344 req-3077bb12-e047-4bad-ab86-a3a50fdd3724 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] No waiting events found dispatching network-vif-unplugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:47 user nova-compute[75000]: WARNING nova.compute.manager [req-251c229e-e9ec-4050-aa66-5a6725dbd344 req-3077bb12-e047-4bad-ab86-a3a50fdd3724 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received unexpected event network-vif-unplugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 for instance with vm_state active and task_state rebuilding.
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --login" returned: 0 in 1.097s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb6757-a738-4f5e-bc17-aab27738b278]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818, portal: 172.16.0.220,3260]
Nov 06 22:31:47 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818, portal: 172.16.0.220,3260] successful.
Nov 06 22:31:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7901c5-197e-453c-ab64-c7d5a70c9d89]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79c6bea-3b29-4780-9c36-bef59db2cc57]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:47 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:47 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:47 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:47 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:47 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:47 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:47 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:47 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.395s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e864a6d-52d0-46f6-a629-7116ba32b0ca]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdOJoHNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:31:47 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Instance destroyed successfully.
Nov 06 22:31:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:47 user nova-compute[75000]: INFO nova.compute.manager [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Detaching volume 076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:31:47 user nova-compute[75000]: INFO nova.virt.block_device [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Attempting to driver detach volume 076b8cb3-faf6-4575-8f2c-a938527eb6f4 from mountpoint /dev/vdb
Nov 06 22:31:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Attempting to detach device vdb from instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:31:47 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:31:47 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:31:47 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:31:47 user nova-compute[75000]:   <serial>076b8cb3-faf6-4575-8f2c-a938527eb6f4</serial>
Nov 06 22:31:47 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:31:47 user nova-compute[75000]: </disk>
Nov 06 22:31:47 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:31:47 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully detached device vdb from instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 from the persistent domain config.
Nov 06 22:31:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFOKHcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:47 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 22:31:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.434s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] <== connect_volume: return (2436ms) {'type': 'block', 'scsi_wwn': '23461376133623434', 'path': '/dev/sdf'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461376133623434', 'path': '/dev/sdf'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.441s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJExraP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:48 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57bd128-5c35-47c3-9301-d6f27338a0e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:31:48 user nova-compute[75000]: No targets found.
Nov 06 22:31:48 user nova-compute[75000]: iSNS:
Nov 06 22:31:48 user nova-compute[75000]: No targets found.
Nov 06 22:31:48 user nova-compute[75000]: STATIC:
Nov 06 22:31:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569
Nov 06 22:31:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:31:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:31:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818
Nov 06 22:31:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:31:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:48 user nova-compute[75000]: FIRMWARE:
Nov 06 22:31:48 user nova-compute[75000]: No targets found.
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:31:48 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:31:48 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[46acbea7-f17c-4ce9-b63e-2f9974a75e29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe39247-504e-4c16-bbb9-2912acf82440]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc3a2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1419a1-3b4a-4e45-a2b3-b15ab74f86a0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2e049-4af0-44bd-9508-2e82f2017a2d]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff00059-be5c-4b5a-a11a-a2cf71782fa6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d1fdcc-2bb6-4068-a7f8-27ba5c16302e]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[264c8e0d-b62e-4f52-b354-8b0c72545608]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c560e3-9990-4f28-a03d-8739828a3a7f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260]
Nov 06 22:31:48 user nova-compute[75000]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260] successful.
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[713bb597-f1b3-4bd2-8f3d-76bb0eb27df7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== disconnect_volume: return (779ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.321s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:48 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:48 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36296643-5bef-4919-8338-40d55fc28a6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:31:48 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecc1573-ab29-48a8-8859-77b15f19e275]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809] added
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[689c8a3d-b3cf-42b5-ba47-e49a58e5e3ee]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f36724-456c-477c-ac29-6a8cbd950100]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzJExraP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzJExraP" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b8c8d1-cebb-41ac-9d83-23b05d2e2cea]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hzJExraP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb90ab-99d2-4cd6-994c-89e0964dce4f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee0003a-7e9d-4785-baca-0be6a3987ca5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d48174e-c5d7-49b5-a5a8-dc6e85bef982]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809, portal: 172.16.0.220,3260]
Nov 06 22:31:48 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809, portal: 172.16.0.220,3260] successful.
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a03a09c-2373-49ac-87bd-13ebd4c9d559]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d853a05-46f5-46a4-b840-11e179e16152]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ad4202-879a-43dc-b72f-ebe2075d7f6c]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:31:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJExraP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-d30438d3-ec0c-4ecf-85d7-5bc1716550a7 req-e262fab1-2e45-431e-a6f1-714757150f08 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d30438d3-ec0c-4ecf-85d7-5bc1716550a7 req-e262fab1-2e45-431e-a6f1-714757150f08 service nova] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d30438d3-ec0c-4ecf-85d7-5bc1716550a7 req-e262fab1-2e45-431e-a6f1-714757150f08 service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d30438d3-ec0c-4ecf-85d7-5bc1716550a7 req-e262fab1-2e45-431e-a6f1-714757150f08 service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-d30438d3-ec0c-4ecf-85d7-5bc1716550a7 req-e262fab1-2e45-431e-a6f1-714757150f08 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] No waiting events found dispatching network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:49 user nova-compute[75000]: WARNING nova.compute.manager [req-d30438d3-ec0c-4ecf-85d7-5bc1716550a7 req-e262fab1-2e45-431e-a6f1-714757150f08 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received unexpected event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 for instance with vm_state active and task_state rebuilding.
Nov 06 22:31:49 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Instance destroyed successfully.
Nov 06 22:31:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1543740670',display_name='tempest-ServerActionsTestOtherA-server-899309665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1543740670',id=14,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmN/VyKWZXuRaaictuLTmDXlTum2xd2CWW45IjcqETXGMmR4MO8Nfu3+mUVy/T9OyJEtn7OQ4adADPNX/Sr89RqeTH93H8uReMub/zXCcqSw9dSeqiAoLDGj3NUacxE7g==',key_name='tempest-keypair-152635658',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-q79vaexu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=4367ded2-3cb6-44bc-a4a2-9b0b4bf98108,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG os_vif [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap884e3b6b-4f, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2586c870-06c3-4a3f-b95d-a9ce0a479330) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:49 user nova-compute[75000]: INFO os_vif [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f')
Nov 06 22:31:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFOKHcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:49 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 22:31:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] <== connect_volume: return (1683ms) {'type': 'block', 'scsi_wwn': '23662373131333065', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662373131333065', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.249s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5f:ee,bridge_name='br-int',has_traffic_filtering=True,id=edd9c5b2-a58a-40e1-a90b-3369f3956182,network=Network(735f189b-f05d-4097-b884-9623beab8c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd9c5b2-a5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=e1a63239-aa0a-4355-9199-1b1def6d7343,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a63239-aa') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b4:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5aefaa0-9af2-47b8-bcd2-3c572594b338,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5aefaa0-9a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8a38f353-bd3b-4a59-a4d3-04728260fdf4,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38f353-bd') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=13a5c008-7743-43d9-89d9-79cb2eb79450,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a5c008-77') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:53:4a,bridge_name='br-int',has_traffic_filtering=True,id=5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b17d3f3-90') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:f2:81,bridge_name='br-int',has_traffic_filtering=True,id=ba040a18-e2d6-4599-a641-f459aed99c3c,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba040a18-e2') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.objects.instance [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lazy-loading 'pci_devices' on Instance uuid c9422249-ff7a-455e-87e1-bdce3e0345f1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d280d0a-7b89-4e25-897c-6dddba2dd70a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:31:50 user nova-compute[75000]: No targets found.
Nov 06 22:31:50 user nova-compute[75000]: iSNS:
Nov 06 22:31:50 user nova-compute[75000]: No targets found.
Nov 06 22:31:50 user nova-compute[75000]: STATIC:
Nov 06 22:31:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569
Nov 06 22:31:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:31:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818
Nov 06 22:31:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:31:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809
Nov 06 22:31:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:50 user nova-compute[75000]: FIRMWARE:
Nov 06 22:31:50 user nova-compute[75000]: No targets found.
Nov 06 22:31:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:31:50 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:31:50 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:31:50 user nova-compute[75000]:   <uuid>c9422249-ff7a-455e-87e1-bdce3e0345f1</uuid>
Nov 06 22:31:50 user nova-compute[75000]:   <name>instance-0000000f</name>
Nov 06 22:31:50 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:31:50 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:31:50 user nova-compute[75000]:   <metadata>
Nov 06 22:31:50 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:31:50 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:31:50 user nova-compute[75000]:       <nova:name>tempest-device-tagging-server-1732079075</nova:name>
Nov 06 22:31:50 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:31:42</nova:creationTime>
Nov 06 22:31:50 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:31:50 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:31:50 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:31:50 user nova-compute[75000]:       <nova:owner>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:user uuid="81298fc90bc8498db1b9a2ecc8d272c8">tempest-TaggedBootDevicesTest_v242-263042162-project-member</nova:user>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:project uuid="af4172b6528d4cb282b1906ef73fadf2">tempest-TaggedBootDevicesTest_v242-263042162</nova:project>
Nov 06 22:31:50 user nova-compute[75000]:       </nova:owner>
Nov 06 22:31:50 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:31:50 user nova-compute[75000]:       <nova:ports>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:port uuid="edd9c5b2-a58a-40e1-a90b-3369f3956182">
Nov 06 22:31:50 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:31:50 user nova-compute[75000]:         </nova:port>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:port uuid="e1a63239-aa0a-4355-9199-1b1def6d7343">
Nov 06 22:31:50 user nova-compute[75000]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Nov 06 22:31:50 user nova-compute[75000]:         </nova:port>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:port uuid="f5aefaa0-9af2-47b8-bcd2-3c572594b338">
Nov 06 22:31:50 user nova-compute[75000]:           <nova:ip type="fixed" address="10.1.1.139" ipVersion="4"/>
Nov 06 22:31:50 user nova-compute[75000]:         </nova:port>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:port uuid="8a38f353-bd3b-4a59-a4d3-04728260fdf4">
Nov 06 22:31:50 user nova-compute[75000]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Nov 06 22:31:50 user nova-compute[75000]:         </nova:port>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:port uuid="13a5c008-7743-43d9-89d9-79cb2eb79450">
Nov 06 22:31:50 user nova-compute[75000]:           <nova:ip type="fixed" address="10.1.1.233" ipVersion="4"/>
Nov 06 22:31:50 user nova-compute[75000]:         </nova:port>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:port uuid="5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727">
Nov 06 22:31:50 user nova-compute[75000]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 06 22:31:50 user nova-compute[75000]:         </nova:port>
Nov 06 22:31:50 user nova-compute[75000]:         <nova:port uuid="ba040a18-e2d6-4599-a641-f459aed99c3c">
Nov 06 22:31:50 user nova-compute[75000]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 06 22:31:50 user nova-compute[75000]:         </nova:port>
Nov 06 22:31:50 user nova-compute[75000]:       </nova:ports>
Nov 06 22:31:50 user nova-compute[75000]:     </nova:instance>
Nov 06 22:31:50 user nova-compute[75000]:   </metadata>
Nov 06 22:31:50 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:31:50 user nova-compute[75000]:     <system>
Nov 06 22:31:50 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:31:50 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:31:50 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:31:50 user nova-compute[75000]:       <entry name="serial">c9422249-ff7a-455e-87e1-bdce3e0345f1</entry>
Nov 06 22:31:50 user nova-compute[75000]:       <entry name="uuid">c9422249-ff7a-455e-87e1-bdce3e0345f1</entry>
Nov 06 22:31:50 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:31:50 user nova-compute[75000]:     </system>
Nov 06 22:31:50 user nova-compute[75000]:   </sysinfo>
Nov 06 22:31:50 user nova-compute[75000]:   <os>
Nov 06 22:31:50 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:31:50 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:31:50 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:31:50 user nova-compute[75000]:   </os>
Nov 06 22:31:50 user nova-compute[75000]:   <features>
Nov 06 22:31:50 user nova-compute[75000]:     <acpi/>
Nov 06 22:31:50 user nova-compute[75000]:     <apic/>
Nov 06 22:31:50 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:31:50 user nova-compute[75000]:   </features>
Nov 06 22:31:50 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:31:50 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:31:50 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:31:50 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:31:50 user nova-compute[75000]:   </clock>
Nov 06 22:31:50 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:31:50 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:31:50 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:31:50 user nova-compute[75000]:   </cpu>
Nov 06 22:31:50 user nova-compute[75000]:   <devices>
Nov 06 22:31:50 user nova-compute[75000]:     <disk type="file" device="cdrom">
Nov 06 22:31:50 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 22:31:50 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/c9422249-ff7a-455e-87e1-bdce3e0345f1/disk.config"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="hda" bus="ide"/>
Nov 06 22:31:50 user nova-compute[75000]:     </disk>
Nov 06 22:31:50 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:31:50 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:31:50 user nova-compute[75000]:       <source dev="/dev/sde"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <serial>2e1fcc01-a3aa-4896-ba3f-f7509a966569</serial>
Nov 06 22:31:50 user nova-compute[75000]:     </disk>
Nov 06 22:31:50 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:31:50 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:31:50 user nova-compute[75000]:       <source dev="/dev/sdf"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <serial>0883f49d-f390-4aba-8a64-388111d2b818</serial>
Nov 06 22:31:50 user nova-compute[75000]:     </disk>
Nov 06 22:31:50 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:31:50 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:31:50 user nova-compute[75000]:       <source dev="/dev/sdc"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="vdc" bus="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <serial>4359b8e6-705d-4b18-a7b2-96b65ca06809</serial>
Nov 06 22:31:50 user nova-compute[75000]:     </disk>
Nov 06 22:31:50 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:31:50 user nova-compute[75000]:       <mac address="fa:16:3e:c9:5f:ee"/>
Nov 06 22:31:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="tapedd9c5b2-a5"/>
Nov 06 22:31:50 user nova-compute[75000]:     </interface>
Nov 06 22:31:50 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:31:50 user nova-compute[75000]:       <mac address="fa:16:3e:99:47:a9"/>
Nov 06 22:31:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="tape1a63239-aa"/>
Nov 06 22:31:50 user nova-compute[75000]:     </interface>
Nov 06 22:31:50 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:31:50 user nova-compute[75000]:       <mac address="fa:16:3e:6d:b4:6d"/>
Nov 06 22:31:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="tapf5aefaa0-9a"/>
Nov 06 22:31:50 user nova-compute[75000]:     </interface>
Nov 06 22:31:50 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:31:50 user nova-compute[75000]:       <mac address="fa:16:3e:a2:6b:2a"/>
Nov 06 22:31:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="tap8a38f353-bd"/>
Nov 06 22:31:50 user nova-compute[75000]:     </interface>
Nov 06 22:31:50 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:31:50 user nova-compute[75000]:       <mac address="fa:16:3e:0b:b9:0a"/>
Nov 06 22:31:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="tap13a5c008-77"/>
Nov 06 22:31:50 user nova-compute[75000]:     </interface>
Nov 06 22:31:50 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:31:50 user nova-compute[75000]:       <mac address="fa:16:3e:6d:53:4a"/>
Nov 06 22:31:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="tap5b17d3f3-90"/>
Nov 06 22:31:50 user nova-compute[75000]:     </interface>
Nov 06 22:31:50 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:31:50 user nova-compute[75000]:       <mac address="fa:16:3e:df:f2:81"/>
Nov 06 22:31:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:31:50 user nova-compute[75000]:       <target dev="tapba040a18-e2"/>
Nov 06 22:31:50 user nova-compute[75000]:     </interface>
Nov 06 22:31:50 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:31:50 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/c9422249-ff7a-455e-87e1-bdce3e0345f1/console.log" append="off"/>
Nov 06 22:31:50 user nova-compute[75000]:     </serial>
Nov 06 22:31:50 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:31:50 user nova-compute[75000]:     <video>
Nov 06 22:31:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:31:50 user nova-compute[75000]:     </video>
Nov 06 22:31:50 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:31:50 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:31:50 user nova-compute[75000]:     </rng>
Nov 06 22:31:50 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:31:50 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:31:50 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:31:50 user nova-compute[75000]:     </memballoon>
Nov 06 22:31:50 user nova-compute[75000]:   </devices>
Nov 06 22:31:50 user nova-compute[75000]: </domain>
Nov 06 22:31:50 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5f:ee,bridge_name='br-int',has_traffic_filtering=True,id=edd9c5b2-a58a-40e1-a90b-3369f3956182,network=Network(735f189b-f05d-4097-b884-9623beab8c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd9c5b2-a5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5f:ee,bridge_name='br-int',has_traffic_filtering=True,id=edd9c5b2-a58a-40e1-a90b-3369f3956182,network=Network(735f189b-f05d-4097-b884-9623beab8c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd9c5b2-a5') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '885c61d5-fd4c-5862-b349-80068e1cc8f5', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c34ce6-9272-4674-bbde-36ae590aa49a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedd9c5b2-a5, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedd9c5b2-a5, col_values=(('qos', UUID('64d026e6-0243-4c68-a022-f44d656ba064')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedd9c5b2-a5, col_values=(('external_ids', {'iface-id': 'edd9c5b2-a58a-40e1-a90b-3369f3956182', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:5f:ee', 'vm-uuid': 'c9422249-ff7a-455e-87e1-bdce3e0345f1'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: INFO os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5f:ee,bridge_name='br-int',has_traffic_filtering=True,id=edd9c5b2-a58a-40e1-a90b-3369f3956182,network=Network(735f189b-f05d-4097-b884-9623beab8c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd9c5b2-a5')
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=e1a63239-aa0a-4355-9199-1b1def6d7343,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a63239-aa') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=e1a63239-aa0a-4355-9199-1b1def6d7343,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a63239-aa') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a28577d-3ba0-41fb-b0f8-a6f6a53001f0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:50 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:50 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:50 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:31:50 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:50 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:50 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:50 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:31:50 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc14b2e0>, {}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Disconnecting from: [] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.134s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== disconnect_volume: return (384ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:31:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Deleting instance files /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108_del
Nov 06 22:31:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Deletion of /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108_del complete
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74bc034a-15ef-5947-a38b-f682f1dff78d', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1a63239-aa, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1a63239-aa, col_values=(('qos', UUID('005b77fb-30be-4fde-85ef-a6a1f48a73f1')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1a63239-aa, col_values=(('external_ids', {'iface-id': 'e1a63239-aa0a-4355-9199-1b1def6d7343', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:47:a9', 'vm-uuid': 'c9422249-ff7a-455e-87e1-bdce3e0345f1'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: INFO os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=e1a63239-aa0a-4355-9199-1b1def6d7343,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a63239-aa')
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b4:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5aefaa0-9af2-47b8-bcd2-3c572594b338,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5aefaa0-9a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b4:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5aefaa0-9af2-47b8-bcd2-3c572594b338,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5aefaa0-9a') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6720ef5-5505-554f-a6da-9201e5eeea3e', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5aefaa0-9a, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5aefaa0-9a, col_values=(('qos', UUID('9ea2ec40-5536-4bd0-9b4b-12748c5206e8')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5aefaa0-9a, col_values=(('external_ids', {'iface-id': 'f5aefaa0-9af2-47b8-bcd2-3c572594b338', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b4:6d', 'vm-uuid': 'c9422249-ff7a-455e-87e1-bdce3e0345f1'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.neutron [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Port f6cb1907-7cf4-46fd-9526-9c885c806ce2 binding to destination host user is already ACTIVE {{(pid=75000) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquired lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.neutron [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: INFO nova.virt.block_device [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Booting with volume 076b8cb3-faf6-4575-8f2c-a938527eb6f4 at /dev/vdb
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: INFO os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b4:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5aefaa0-9af2-47b8-bcd2-3c572594b338,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5aefaa0-9a')
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8a38f353-bd3b-4a59-a4d3-04728260fdf4,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38f353-bd') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8a38f353-bd3b-4a59-a4d3-04728260fdf4,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38f353-bd') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46d737fe-5e74-54d8-8efe-fd8bbecf5e61', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a38f353-bd, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a38f353-bd, col_values=(('qos', UUID('8cffc6d3-43fa-41bb-9551-b1bd724d6ea4')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a38f353-bd, col_values=(('external_ids', {'iface-id': '8a38f353-bd3b-4a59-a4d3-04728260fdf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:6b:2a', 'vm-uuid': 'c9422249-ff7a-455e-87e1-bdce3e0345f1'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.utils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: INFO os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8a38f353-bd3b-4a59-a4d3-04728260fdf4,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38f353-bd')
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=13a5c008-7743-43d9-89d9-79cb2eb79450,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a5c008-77') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=13a5c008-7743-43d9-89d9-79cb2eb79450,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a5c008-77') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a889db-70b0-43b7-b0ba-16ba6c7969b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '938798d8-22bf-5a2b-8a04-c1afd6c031cb', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dd5301-a7e7-4958-b9cc-8e212dce17e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b695e7-bc49-4349-be36-8f1675b25252]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[70276106-34c6-4ec9-b3a9-b854de4fd4c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13a5c008-77, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13a5c008-77, col_values=(('qos', UUID('9434f0ae-0342-4c1a-ac38-18dd394c9533')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13a5c008-77, col_values=(('external_ids', {'iface-id': '13a5c008-7743-43d9-89d9-79cb2eb79450', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:b9:0a', 'vm-uuid': 'c9422249-ff7a-455e-87e1-bdce3e0345f1'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:31:50 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:31:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e3608d-597d-4d8b-9bab-4d20f69d26b9]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_brick.utils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Updating existing volume attachment record: a1e2709c-a30c-4312-aa33-548e9068770f {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: INFO os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=13a5c008-7743-43d9-89d9-79cb2eb79450,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a5c008-77')
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:53:4a,bridge_name='br-int',has_traffic_filtering=True,id=5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b17d3f3-90') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:53:4a,bridge_name='br-int',has_traffic_filtering=True,id=5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b17d3f3-90') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e3f586e-2ca4-59b3-857c-f97cbe0c57da', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b17d3f3-90, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b17d3f3-90, col_values=(('qos', UUID('4c1b28c1-047b-4828-a677-26903921159f')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b17d3f3-90, col_values=(('external_ids', {'iface-id': '5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:53:4a', 'vm-uuid': 'c9422249-ff7a-455e-87e1-bdce3e0345f1'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: INFO os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:53:4a,bridge_name='br-int',has_traffic_filtering=True,id=5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b17d3f3-90')
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:f2:81,bridge_name='br-int',has_traffic_filtering=True,id=ba040a18-e2d6-4599-a641-f459aed99c3c,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba040a18-e2') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f2:81,bridge_name='br-int',has_traffic_filtering=True,id=ba040a18-e2d6-4599-a641-f459aed99c3c,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba040a18-e2') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fb1d1b4-e29d-5ccb-8d85-517c68810403', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba040a18-e2, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba040a18-e2, col_values=(('qos', UUID('adc9a01f-9a1b-49e2-a885-2119a763353d')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba040a18-e2, col_values=(('external_ids', {'iface-id': 'ba040a18-e2d6-4599-a641-f459aed99c3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:f2:81', 'vm-uuid': 'c9422249-ff7a-455e-87e1-bdce3e0345f1'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:50 user nova-compute[75000]: INFO os_vif [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f2:81,bridge_name='br-int',has_traffic_filtering=True,id=ba040a18-e2d6-4599-a641-f459aed99c3c,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba040a18-e2')
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] No BDM found with device name hda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] No VIF found with MAC fa:16:3e:c9:5f:ee, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] No VIF found with MAC fa:16:3e:0b:b9:0a, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:31:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Using config drive
Nov 06 22:31:50 user nova-compute[75000]: DEBUG nova.network.neutron [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance_info_cache with network_info: [{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Releasing lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Creating tmpfile /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/tmp610ygx1o to verify with other compute node that the instance is on the same shared storage. {{(pid=75000) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 06 22:31:51 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Creating config drive at /opt/stack/data/nova/instances/c9422249-ff7a-455e-87e1-bdce3e0345f1/disk.config
Nov 06 22:31:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c9422249-ff7a-455e-87e1-bdce3e0345f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeg5zibsv {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c9422249-ff7a-455e-87e1-bdce3e0345f1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeg5zibsv" returned: 0 in 0.079s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-aa5ac37f-4ba1-4436-8a9a-f727fd2a9536 req-d6ce9362-14df-4069-873c-b350881197bb service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-unplugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-aa5ac37f-4ba1-4436-8a9a-f727fd2a9536 req-d6ce9362-14df-4069-873c-b350881197bb service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-aa5ac37f-4ba1-4436-8a9a-f727fd2a9536 req-d6ce9362-14df-4069-873c-b350881197bb service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-aa5ac37f-4ba1-4436-8a9a-f727fd2a9536 req-d6ce9362-14df-4069-873c-b350881197bb service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-aa5ac37f-4ba1-4436-8a9a-f727fd2a9536 req-d6ce9362-14df-4069-873c-b350881197bb service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-unplugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:51 user nova-compute[75000]: WARNING nova.compute.manager [req-aa5ac37f-4ba1-4436-8a9a-f727fd2a9536 req-d6ce9362-14df-4069-873c-b350881197bb service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-unplugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state resized and task_state resize_reverting.
Nov 06 22:31:52 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance destroyed successfully.
Nov 06 22:31:52 user nova-compute[75000]: DEBUG nova.objects.instance [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lazy-loading 'resources' on Instance uuid 846bf5e2-230c-419c-be77-982acc036b40 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-410044661',display_name='tempest-ServerActionsTestOtherB-server-410044661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-410044661',id=6,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN127j9rMCzJhcsyMMnA9oMyDSW626YDveQjSPb2IR7mcffJ8blZhWvgtIPRXJ9KDmmNRktgeSU8SDicFRInDOK2YoxINbUZ+i2iHac2q1b7ra/rMkxI3W72lm49ZRgf7w==',key_name='tempest-keypair-1677332467',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:30:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54eb33cd621c4fa78fead18be74916ee',ramdisk_id='',reservation_id='r-nlmmujhg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-408033839',owner_user_name='tempest-ServerActionsTestOtherB-408033839-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8b116c4cb154ce0a1a80045258cd123',uuid=846bf5e2-230c-419c-be77-982acc036b40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converting VIF {"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_vif [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6cb1907-7c, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b41603a3-f85d-44dc-9d15-c8331d602864) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:52 user nova-compute[75000]: INFO os_vif [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c')
Nov 06 22:31:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:52 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ff0eb4-8f3c-4c84-ad11-2a19f147b3f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:31:52 user nova-compute[75000]: No targets found.
Nov 06 22:31:52 user nova-compute[75000]: iSNS:
Nov 06 22:31:52 user nova-compute[75000]: No targets found.
Nov 06 22:31:52 user nova-compute[75000]: STATIC:
Nov 06 22:31:52 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569
Nov 06 22:31:52 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:52 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:52 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:31:52 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:52 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:52 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818
Nov 06 22:31:52 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:52 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:52 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:31:52 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:52 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:52 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809
Nov 06 22:31:52 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:31:52 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:31:52 user nova-compute[75000]: FIRMWARE:
Nov 06 22:31:52 user nova-compute[75000]: No targets found.
Nov 06 22:31:52 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:31:52 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:31:52 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40320bfd-f430-4b7c-a458-09255f4285e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7d97e3-9431-4f36-8539-093a5853d1c4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:52 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:52 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:52 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:31:52 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:52 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:31:52 user nova-compute[75000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:31:52 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:31:52 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:31:52 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:31:52 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc295b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e'): ({'sdd'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Removing single pathed devices sdd {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fdd15c-493c-4309-b202-fe5e5c0d38ae]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f75cdc-934a-4fb7-933c-ebcddbc83707]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Flushing IO for device /dev/sdd {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca84f87c-aefa-4272-b1e9-1192cd069e96]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a44fff-c08a-4bf0-ab98-77fabb748c2b]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7b0ff6-6bc3-4235-bf8d-ab57bc8f394a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[788d545a-9dd3-444b-864a-9c54918b5d4b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]
Nov 06 22:31:52 user nova-compute[75000]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.
Nov 06 22:31:52 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf6f82d-627c-4c35-b509-5955da738bca]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] <== disconnect_volume: return (369ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-8c19afec-8970-4617-9198-a57ee27e1d9e req-af9247eb-dcf1-484b-b859-e371677c5b64 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8c19afec-8970-4617-9198-a57ee27e1d9e req-af9247eb-dcf1-484b-b859-e371677c5b64 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8c19afec-8970-4617-9198-a57ee27e1d9e req-af9247eb-dcf1-484b-b859-e371677c5b64 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8c19afec-8970-4617-9198-a57ee27e1d9e req-af9247eb-dcf1-484b-b859-e371677c5b64 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-8c19afec-8970-4617-9198-a57ee27e1d9e req-af9247eb-dcf1-484b-b859-e371677c5b64 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:53 user nova-compute[75000]: WARNING nova.compute.manager [req-8c19afec-8970-4617-9198-a57ee27e1d9e req-af9247eb-dcf1-484b-b859-e371677c5b64 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 for instance with vm_state building and task_state spawning.
Nov 06 22:31:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-15fd089e-e752-4806-b04a-d9fbf0261a27 req-15c8b395-3c0a-458c-9441-229e7e6bdf95 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-15fd089e-e752-4806-b04a-d9fbf0261a27 req-15c8b395-3c0a-458c-9441-229e7e6bdf95 service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-15fd089e-e752-4806-b04a-d9fbf0261a27 req-15c8b395-3c0a-458c-9441-229e7e6bdf95 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-15fd089e-e752-4806-b04a-d9fbf0261a27 req-15c8b395-3c0a-458c-9441-229e7e6bdf95 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-15fd089e-e752-4806-b04a-d9fbf0261a27 req-15c8b395-3c0a-458c-9441-229e7e6bdf95 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:53 user nova-compute[75000]: WARNING nova.compute.manager [req-15fd089e-e752-4806-b04a-d9fbf0261a27 req-15c8b395-3c0a-458c-9441-229e7e6bdf95 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state resized and task_state resize_reverting.
Nov 06 22:31:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG nova.objects.instance [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lazy-loading 'migration_context' on Instance uuid 846bf5e2-230c-419c-be77-982acc036b40 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG nova.objects.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Object Instance<846bf5e2-230c-419c-be77-982acc036b40> lazy-loaded attributes: resources,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.684s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: INFO nova.compute.manager [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Swapping old allocation on dict_keys(['41c3d89d-3143-4eef-b1f4-8f3c2c4411da']) held by migration de7322ef-e0f7-48fc-be65-bc1fc3f4385c for instance
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Overwriting current allocation {'allocations': {'41c3d89d-3143-4eef-b1f4-8f3c2c4411da': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': '54eb33cd621c4fa78fead18be74916ee', 'user_id': 'c8b116c4cb154ce0a1a80045258cd123', 'consumer_generation': 1} on consumer 846bf5e2-230c-419c-be77-982acc036b40 {{(pid=75000) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:55 user nova-compute[75000]: WARNING nova.compute.manager [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 for instance with vm_state building and task_state spawning.
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:55 user nova-compute[75000]: WARNING nova.compute.manager [req-0ddc75a7-db2e-4497-a2a9-72ddaed1d2ce req-1b0a42e8-31ac-454c-b6e4-a8360d0e02b4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-13a5c008-7743-43d9-89d9-79cb2eb79450 for instance with vm_state building and task_state spawning.
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:55 user nova-compute[75000]: WARNING nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-e1a63239-aa0a-4355-9199-1b1def6d7343 for instance with vm_state building and task_state spawning.
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:55 user nova-compute[75000]: WARNING nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-e1a63239-aa0a-4355-9199-1b1def6d7343 for instance with vm_state building and task_state spawning.
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:55 user nova-compute[75000]: WARNING nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 for instance with vm_state building and task_state spawning.
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:55 user nova-compute[75000]: WARNING nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 for instance with vm_state building and task_state spawning.
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:55 user nova-compute[75000]: WARNING nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 for instance with vm_state building and task_state spawning.
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:55 user nova-compute[75000]: WARNING nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 for instance with vm_state building and task_state spawning.
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:55 user nova-compute[75000]: WARNING nova.compute.manager [req-e0c797e2-131e-45a6-90b4-8d2390fb5da7 req-42dfa1ec-43c8-4770-b1c7-cefd67cc0c45 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-ba040a18-e2d6-4599-a641-f459aed99c3c for instance with vm_state building and task_state spawning.
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquired lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG nova.network.neutron [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG nova.network.neutron [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance_info_cache with network_info: [{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Releasing lock "refresh_cache-846bf5e2-230c-419c-be77-982acc036b40" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG os_brick.utils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07c25bf-f770-44c0-bc52-a38466ee8bc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16ce1ea-0612-4b62-8253-51e3e71efdd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[599aa597-7811-4b2d-954c-2b874417e073]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca76980-2cdc-4099-849f-88309e6f78f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:31:56 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:31:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11996fa-d82c-4294-ac07-28b6d8f4ea5f]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG os_brick.utils [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-c59a5438-18f1-4cc4-a30c-5410c48ea07c req-ad624a12-1dd7-4823-9bc0-51bdacbce8af service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c59a5438-18f1-4cc4-a30c-5410c48ea07c req-ad624a12-1dd7-4823-9bc0-51bdacbce8af service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c59a5438-18f1-4cc4-a30c-5410c48ea07c req-ad624a12-1dd7-4823-9bc0-51bdacbce8af service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c59a5438-18f1-4cc4-a30c-5410c48ea07c req-ad624a12-1dd7-4823-9bc0-51bdacbce8af service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-c59a5438-18f1-4cc4-a30c-5410c48ea07c req-ad624a12-1dd7-4823-9bc0-51bdacbce8af service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:57 user nova-compute[75000]: WARNING nova.compute.manager [req-c59a5438-18f1-4cc4-a30c-5410c48ea07c req-ad624a12-1dd7-4823-9bc0-51bdacbce8af service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-ba040a18-e2d6-4599-a641-f459aed99c3c for instance with vm_state building and task_state spawning.
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:57 user nova-compute[75000]: WARNING nova.compute.manager [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-13a5c008-7743-43d9-89d9-79cb2eb79450 for instance with vm_state building and task_state spawning.
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:57 user nova-compute[75000]: WARNING nova.compute.manager [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 for instance with vm_state building and task_state spawning.
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:31:57 user nova-compute[75000]: WARNING nova.compute.manager [req-0daae9db-78f9-4db4-85a5-1f78c5d7e714 req-6cac7797-5d29-45a6-822b-9bf26f976b13 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 for instance with vm_state building and task_state spawning.
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:31:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance spawned successfully.
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:31:57 user nova-compute[75000]: INFO nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Took 14.91 seconds to spawn the instance on the hypervisor.
Nov 06 22:31:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:31:57 user nova-compute[75000]: INFO nova.compute.manager [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Took 118.12 seconds to build instance.
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6366957f-cabc-462c-9ff3-d6e5e477444f tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 118.245s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 21.767s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:58 user nova-compute[75000]: INFO nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 06 22:31:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:31:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:31:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:31:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:31:59 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:31:59 user nova-compute[75000]: INFO nova.compute.claims [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Claim successful on node user
Nov 06 22:31:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:32:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:32:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:32:00 user nova-compute[75000]: INFO nova.virt.block_device [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Booting with volume 51516dc7-babc-4eda-866e-0245b93bdec0 at /dev/vda
Nov 06 22:32:00 user nova-compute[75000]: DEBUG os_brick.utils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cd6ab8-a981-4478-b115-ad29453805f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG nova.policy [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbceb6180510486c8f3bd60985e0b5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df531ecc8a244028bad3f3cbd63eaf57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d5177d-61d4-4637-a741-24f129705b58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b5318e-79e2-4753-998e-60980cd536e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[284ba131-1ffc-46a1-ab17-9fcdbb28d883]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:32:00 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:32:00 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cf8b28-4243-4569-a644-8931b0b16728]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG os_brick.utils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:32:00 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating existing volume attachment record: 5e1e7540-363f-4643-b545-a056e093a0f5 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:32:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully created port: 3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:32:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully created port: 7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:32:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully created port: fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:32:03 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully created port: 03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:32:04 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully created port: e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:32:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully updated port: 3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:32:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-2dc8655f-92c6-4f9c-b6a1-e4d9769900b6 req-711477c0-3a4d-4973-b21e-13cd875d03a8 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-changed-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-2dc8655f-92c6-4f9c-b6a1-e4d9769900b6 req-711477c0-3a4d-4973-b21e-13cd875d03a8 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing instance network info cache due to event network-changed-3a779839-57b1-4b62-82c4-7a7cc7eb2abe. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:32:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2dc8655f-92c6-4f9c-b6a1-e4d9769900b6 req-711477c0-3a4d-4973-b21e-13cd875d03a8 service nova] Acquiring lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2dc8655f-92c6-4f9c-b6a1-e4d9769900b6 req-711477c0-3a4d-4973-b21e-13cd875d03a8 service nova] Acquired lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-2dc8655f-92c6-4f9c-b6a1-e4d9769900b6 req-711477c0-3a4d-4973-b21e-13cd875d03a8 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing network info cache for port 3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:32:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-2dc8655f-92c6-4f9c-b6a1-e4d9769900b6 req-711477c0-3a4d-4973-b21e-13cd875d03a8 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:32:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-2dc8655f-92c6-4f9c-b6a1-e4d9769900b6 req-711477c0-3a4d-4973-b21e-13cd875d03a8 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2dc8655f-92c6-4f9c-b6a1-e4d9769900b6 req-711477c0-3a4d-4973-b21e-13cd875d03a8 service nova] Releasing lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully updated port: 54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:32:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully updated port: 99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "98957082-bdb6-472c-9462-f3e8d7340a20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98957082-bdb6-472c-9462-f3e8d7340a20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:32:07 user nova-compute[75000]: INFO nova.compute.claims [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Claim successful on node user
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-changed-54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing instance network info cache due to event network-changed-54546932-5914-428a-bbdc-887e3b128f96. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] Acquiring lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] Acquired lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing network info cache for port 54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] Releasing lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-changed-99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing instance network info cache due to event network-changed-99865ff8-659c-4199-b3c9-371b5481c5ac. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] Acquiring lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] Acquired lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing network info cache for port 99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:32:08 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.policy [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20cf456ef1044f7387512475b494365e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248d06b9dfbf4cd69d8d9630aea9ab36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully updated port: 7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:32:08 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Creating image(s)
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "/opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "/opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "/opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-61948952-0011-4aef-908e-9eb43b5f5b48 req-9e4843d6-604a-4403-85ab-88b058ef7994 service nova] Releasing lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk 1073741824" returned: 0 in 0.066s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Successfully created port: 6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully updated port: fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Cannot resize image /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Ensure instance console log exists: /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-changed-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing instance network info cache due to event network-changed-7a27d08a-1050-40f1-9af8-f05e3b4a39c4. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] Acquiring lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] Acquired lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing network info cache for port 7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Successfully updated port: 6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "refresh_cache-98957082-bdb6-472c-9462-f3e8d7340a20" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquired lock "refresh_cache-98957082-bdb6-472c-9462-f3e8d7340a20" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-52e3ecdd-9fa9-42f8-a08f-3eb555750166 req-bc5fff84-3159-447b-81fd-d58f5f6e2855 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received event network-changed-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-52e3ecdd-9fa9-42f8-a08f-3eb555750166 req-bc5fff84-3159-447b-81fd-d58f5f6e2855 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Refreshing instance network info cache due to event network-changed-6cacef1c-52d0-4527-80b6-4c22a783e8e8. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-52e3ecdd-9fa9-42f8-a08f-3eb555750166 req-bc5fff84-3159-447b-81fd-d58f5f6e2855 service nova] Acquiring lock "refresh_cache-98957082-bdb6-472c-9462-f3e8d7340a20" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] Releasing lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-changed-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing instance network info cache due to event network-changed-fa4338d3-8249-4aab-8e23-8d254737e00b. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] Acquiring lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] Acquired lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing network info cache for port fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.neutron [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Updating instance_info_cache with network_info: [{"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Releasing lock "refresh_cache-98957082-bdb6-472c-9462-f3e8d7340a20" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Instance network_info: |[{"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-52e3ecdd-9fa9-42f8-a08f-3eb555750166 req-bc5fff84-3159-447b-81fd-d58f5f6e2855 service nova] Acquired lock "refresh_cache-98957082-bdb6-472c-9462-f3e8d7340a20" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.neutron [req-52e3ecdd-9fa9-42f8-a08f-3eb555750166 req-bc5fff84-3159-447b-81fd-d58f5f6e2855 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Refreshing network info cache for port 6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Start _get_guest_xml network_info=[{"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:32:10 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:32:10 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1784111207',display_name='tempest-ServersNegativeTestJSON-server-1784111207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1784111207',id=20,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='248d06b9dfbf4cd69d8d9630aea9ab36',ramdisk_id='',reservation_id='r-92xa940o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1355389518',owner_user_name='tempest-ServersNegativeTestJSON-1355389518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:08Z,user_data=None,user_id='20cf456ef1044f7387512475b494365e',uuid=98957082-bdb6-472c-9462-f3e8d7340a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converting VIF {"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:47:0a,bridge_name='br-int',has_traffic_filtering=True,id=6cacef1c-52d0-4527-80b6-4c22a783e8e8,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cacef1c-52') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.objects.instance [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lazy-loading 'pci_devices' on Instance uuid 98957082-bdb6-472c-9462-f3e8d7340a20 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:32:10 user nova-compute[75000]:   <uuid>98957082-bdb6-472c-9462-f3e8d7340a20</uuid>
Nov 06 22:32:10 user nova-compute[75000]:   <name>instance-00000014</name>
Nov 06 22:32:10 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:32:10 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:32:10 user nova-compute[75000]:   <metadata>
Nov 06 22:32:10 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:32:10 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:32:10 user nova-compute[75000]:       <nova:name>tempest-ServersNegativeTestJSON-server-1784111207</nova:name>
Nov 06 22:32:10 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:32:10</nova:creationTime>
Nov 06 22:32:10 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:32:10 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:32:10 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:32:10 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:32:10 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:32:10 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:32:10 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:32:10 user nova-compute[75000]:       <nova:owner>
Nov 06 22:32:10 user nova-compute[75000]:         <nova:user uuid="20cf456ef1044f7387512475b494365e">tempest-ServersNegativeTestJSON-1355389518-project-member</nova:user>
Nov 06 22:32:10 user nova-compute[75000]:         <nova:project uuid="248d06b9dfbf4cd69d8d9630aea9ab36">tempest-ServersNegativeTestJSON-1355389518</nova:project>
Nov 06 22:32:10 user nova-compute[75000]:       </nova:owner>
Nov 06 22:32:10 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:32:10 user nova-compute[75000]:       <nova:ports>
Nov 06 22:32:10 user nova-compute[75000]:         <nova:port uuid="6cacef1c-52d0-4527-80b6-4c22a783e8e8">
Nov 06 22:32:10 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 22:32:10 user nova-compute[75000]:         </nova:port>
Nov 06 22:32:10 user nova-compute[75000]:       </nova:ports>
Nov 06 22:32:10 user nova-compute[75000]:     </nova:instance>
Nov 06 22:32:10 user nova-compute[75000]:   </metadata>
Nov 06 22:32:10 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:32:10 user nova-compute[75000]:     <system>
Nov 06 22:32:10 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:32:10 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:32:10 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:32:10 user nova-compute[75000]:       <entry name="serial">98957082-bdb6-472c-9462-f3e8d7340a20</entry>
Nov 06 22:32:10 user nova-compute[75000]:       <entry name="uuid">98957082-bdb6-472c-9462-f3e8d7340a20</entry>
Nov 06 22:32:10 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:32:10 user nova-compute[75000]:     </system>
Nov 06 22:32:10 user nova-compute[75000]:   </sysinfo>
Nov 06 22:32:10 user nova-compute[75000]:   <os>
Nov 06 22:32:10 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:32:10 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:32:10 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:32:10 user nova-compute[75000]:   </os>
Nov 06 22:32:10 user nova-compute[75000]:   <features>
Nov 06 22:32:10 user nova-compute[75000]:     <acpi/>
Nov 06 22:32:10 user nova-compute[75000]:     <apic/>
Nov 06 22:32:10 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:32:10 user nova-compute[75000]:   </features>
Nov 06 22:32:10 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:32:10 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:32:10 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:32:10 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:32:10 user nova-compute[75000]:   </clock>
Nov 06 22:32:10 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:32:10 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:32:10 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:32:10 user nova-compute[75000]:   </cpu>
Nov 06 22:32:10 user nova-compute[75000]:   <devices>
Nov 06 22:32:10 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:32:10 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:32:10 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk"/>
Nov 06 22:32:10 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:32:10 user nova-compute[75000]:     </disk>
Nov 06 22:32:10 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:32:10 user nova-compute[75000]:       <mac address="fa:16:3e:ee:47:0a"/>
Nov 06 22:32:10 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:32:10 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:32:10 user nova-compute[75000]:       <target dev="tap6cacef1c-52"/>
Nov 06 22:32:10 user nova-compute[75000]:     </interface>
Nov 06 22:32:10 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:32:10 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/console.log" append="off"/>
Nov 06 22:32:10 user nova-compute[75000]:     </serial>
Nov 06 22:32:10 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:32:10 user nova-compute[75000]:     <video>
Nov 06 22:32:10 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:32:10 user nova-compute[75000]:     </video>
Nov 06 22:32:10 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:32:10 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:32:10 user nova-compute[75000]:     </rng>
Nov 06 22:32:10 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:32:10 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:32:10 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:32:10 user nova-compute[75000]:     </memballoon>
Nov 06 22:32:10 user nova-compute[75000]:   </devices>
Nov 06 22:32:10 user nova-compute[75000]: </domain>
Nov 06 22:32:10 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1784111207',display_name='tempest-ServersNegativeTestJSON-server-1784111207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1784111207',id=20,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='248d06b9dfbf4cd69d8d9630aea9ab36',ramdisk_id='',reservation_id='r-92xa940o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1355389518',owner_user_name='tempest-ServersNegativeTestJSON-1355389518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:08Z,user_data=None,user_id='20cf456ef1044f7387512475b494365e',uuid=98957082-bdb6-472c-9462-f3e8d7340a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converting VIF {"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:47:0a,bridge_name='br-int',has_traffic_filtering=True,id=6cacef1c-52d0-4527-80b6-4c22a783e8e8,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cacef1c-52') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG os_vif [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:47:0a,bridge_name='br-int',has_traffic_filtering=True,id=6cacef1c-52d0-4527-80b6-4c22a783e8e8,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cacef1c-52') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.neutron [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a564b504-216b-5d54-a7a9-4bd65b211b98', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cacef1c-52, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cacef1c-52, col_values=(('qos', UUID('a5d61ede-16d2-4d20-9fc6-c259a78ffac2')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cacef1c-52, col_values=(('external_ids', {'iface-id': '6cacef1c-52d0-4527-80b6-4c22a783e8e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:47:0a', 'vm-uuid': '98957082-bdb6-472c-9462-f3e8d7340a20'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-df7b8eae-b691-4c06-9872-ce460e0b2591 req-76a76f91-36c8-4bbf-a9e0-2e52438a4d97 service nova] Releasing lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:10 user nova-compute[75000]: INFO os_vif [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:47:0a,bridge_name='br-int',has_traffic_filtering=True,id=6cacef1c-52d0-4527-80b6-4c22a783e8e8,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cacef1c-52')
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully updated port: 03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] No VIF found with MAC fa:16:3e:ee:47:0a, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.neutron [req-52e3ecdd-9fa9-42f8-a08f-3eb555750166 req-bc5fff84-3159-447b-81fd-d58f5f6e2855 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Updated VIF entry in instance network info cache for port 6cacef1c-52d0-4527-80b6-4c22a783e8e8. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG nova.network.neutron [req-52e3ecdd-9fa9-42f8-a08f-3eb555750166 req-bc5fff84-3159-447b-81fd-d58f5f6e2855 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Updating instance_info_cache with network_info: [{"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-52e3ecdd-9fa9-42f8-a08f-3eb555750166 req-bc5fff84-3159-447b-81fd-d58f5f6e2855 service nova] Releasing lock "refresh_cache-98957082-bdb6-472c-9462-f3e8d7340a20" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Successfully updated port: e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-40fa644b-d761-42f6-b9b2-c8c6d5e0ca5a req-1eddbedd-40bf-4efb-ba86-39f7f5165283 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-changed-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-40fa644b-d761-42f6-b9b2-c8c6d5e0ca5a req-1eddbedd-40bf-4efb-ba86-39f7f5165283 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing instance network info cache due to event network-changed-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-40fa644b-d761-42f6-b9b2-c8c6d5e0ca5a req-1eddbedd-40bf-4efb-ba86-39f7f5165283 service nova] Acquiring lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-40fa644b-d761-42f6-b9b2-c8c6d5e0ca5a req-1eddbedd-40bf-4efb-ba86-39f7f5165283 service nova] Acquired lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-40fa644b-d761-42f6-b9b2-c8c6d5e0ca5a req-1eddbedd-40bf-4efb-ba86-39f7f5165283 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing network info cache for port 03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-40fa644b-d761-42f6-b9b2-c8c6d5e0ca5a req-1eddbedd-40bf-4efb-ba86-39f7f5165283 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-40fa644b-d761-42f6-b9b2-c8c6d5e0ca5a req-1eddbedd-40bf-4efb-ba86-39f7f5165283 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-40fa644b-d761-42f6-b9b2-c8c6d5e0ca5a req-1eddbedd-40bf-4efb-ba86-39f7f5165283 service nova] Releasing lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquired lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-7664ccec-581d-44f8-8db4-a595fd3a1cba req-78edbc27-9ff3-42d6-8dc1-6c7d7d988bcf service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received event network-vif-plugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7664ccec-581d-44f8-8db4-a595fd3a1cba req-78edbc27-9ff3-42d6-8dc1-6c7d7d988bcf service nova] Acquiring lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7664ccec-581d-44f8-8db4-a595fd3a1cba req-78edbc27-9ff3-42d6-8dc1-6c7d7d988bcf service nova] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7664ccec-581d-44f8-8db4-a595fd3a1cba req-78edbc27-9ff3-42d6-8dc1-6c7d7d988bcf service nova] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-7664ccec-581d-44f8-8db4-a595fd3a1cba req-78edbc27-9ff3-42d6-8dc1-6c7d7d988bcf service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] No waiting events found dispatching network-vif-plugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:12 user nova-compute[75000]: WARNING nova.compute.manager [req-7664ccec-581d-44f8-8db4-a595fd3a1cba req-78edbc27-9ff3-42d6-8dc1-6c7d7d988bcf service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received unexpected event network-vif-plugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 for instance with vm_state building and task_state spawning.
Nov 06 22:32:12 user nova-compute[75000]: INFO nova.compute.manager [None req-ac1ff6e9-d40a-4120-8c59-8127c6da21f0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Unrescuing
Nov 06 22:32:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ac1ff6e9-d40a-4120-8c59-8127c6da21f0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ac1ff6e9-d40a-4120-8c59-8127c6da21f0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquired lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ac1ff6e9-d40a-4120-8c59-8127c6da21f0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:32:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-4194941e-af6e-4a52-a4bd-e7304cd97c8d req-7cc7e99d-7a27-418d-a4f0-e9e4f8abe3e1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-changed-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-4194941e-af6e-4a52-a4bd-e7304cd97c8d req-7cc7e99d-7a27-418d-a4f0-e9e4f8abe3e1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing instance network info cache due to event network-changed-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:32:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4194941e-af6e-4a52-a4bd-e7304cd97c8d req-7cc7e99d-7a27-418d-a4f0-e9e4f8abe3e1 service nova] Acquiring lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:13 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ac1ff6e9-d40a-4120-8c59-8127c6da21f0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updating instance_info_cache with network_info: [{"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ac1ff6e9-d40a-4120-8c59-8127c6da21f0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Releasing lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:13 user nova-compute[75000]: DEBUG nova.objects.instance [None req-ac1ff6e9-d40a-4120-8c59-8127c6da21f0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'flavor' on Instance uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:32:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.network.neutron [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [{"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Releasing lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance network_info: |[{"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4194941e-af6e-4a52-a4bd-e7304cd97c8d req-7cc7e99d-7a27-418d-a4f0-e9e4f8abe3e1 service nova] Acquired lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-4194941e-af6e-4a52-a4bd-e7304cd97c8d req-7cc7e99d-7a27-418d-a4f0-e9e4f8abe3e1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing network info cache for port e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received event network-vif-plugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] Acquiring lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] No waiting events found dispatching network-vif-plugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:14 user nova-compute[75000]: WARNING nova.compute.manager [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received unexpected event network-vif-plugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 for instance with vm_state building and task_state spawning.
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-unplugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-unplugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:14 user nova-compute[75000]: WARNING nova.compute.manager [req-a900d591-4d08-4cc3-bace-310d7f6a40ed req-ad274078-0a60-4e11-83d9-757421533802 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-unplugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:32:14 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Instance spawned successfully.
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:14 user nova-compute[75000]: INFO nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:32:14 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Instance destroyed successfully.
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-4194941e-af6e-4a52-a4bd-e7304cd97c8d req-7cc7e99d-7a27-418d-a4f0-e9e4f8abe3e1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updated VIF entry in instance network info cache for port e13357c8-b09a-41d6-9ccb-36a02e3ce2e1. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-4194941e-af6e-4a52-a4bd-e7304cd97c8d req-7cc7e99d-7a27-418d-a4f0-e9e4f8abe3e1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [{"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:14 user nova-compute[75000]: INFO nova.compute.manager [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Took 7.54 seconds to build instance.
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4194941e-af6e-4a52-a4bd-e7304cd97c8d req-7cc7e99d-7a27-418d-a4f0-e9e4f8abe3e1 service nova] Releasing lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ce7ccd27-74e3-4b96-a40b-5d1f4e79a27a tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98957082-bdb6-472c-9462-f3e8d7340a20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.671s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:16 user nova-compute[75000]: WARNING nova.compute.manager [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:32:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:16 user nova-compute[75000]: WARNING nova.compute.manager [req-13708bc4-f9dd-48b9-af4d-8fb085ebb595 req-7d8e5400-c40b-4bd1-af47-8d44e88a6415 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:32:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:32:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Creating image(s)
Nov 06 22:32:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk 1073741824" returned: 0 in 0.073s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-e370c20e-0800-4c7b-bb69-1c09da54d2b0 req-3787a1a1-0e22-4ee2-ac8d-8ba7d93f0050 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e370c20e-0800-4c7b-bb69-1c09da54d2b0 req-3787a1a1-0e22-4ee2-ac8d-8ba7d93f0050 service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e370c20e-0800-4c7b-bb69-1c09da54d2b0 req-3787a1a1-0e22-4ee2-ac8d-8ba7d93f0050 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e370c20e-0800-4c7b-bb69-1c09da54d2b0 req-3787a1a1-0e22-4ee2-ac8d-8ba7d93f0050 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-e370c20e-0800-4c7b-bb69-1c09da54d2b0 req-3787a1a1-0e22-4ee2-ac8d-8ba7d93f0050 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:18 user nova-compute[75000]: WARNING nova.compute.manager [req-e370c20e-0800-4c7b-bb69-1c09da54d2b0 req-3787a1a1-0e22-4ee2-ac8d-8ba7d93f0050 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:18 user nova-compute[75000]: INFO nova.compute.manager [None req-b1fa71db-2d18-44fb-b377-92f7f301233e tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Unrescuing
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b1fa71db-2d18-44fb-b377-92f7f301233e tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b1fa71db-2d18-44fb-b377-92f7f301233e tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquired lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.network.neutron [None req-b1fa71db-2d18-44fb-b377-92f7f301233e tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ac1ff6e9-d40a-4120-8c59-8127c6da21f0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Cannot resize image /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Ensure instance console log exists: /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Start _get_guest_xml network_info=[{"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFOKHcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4367ded2-3cb6-44bc-a4a2-9b0b4bf98108', 'attached_at': '', 'detached_at': '', 'volume_id': '076b8cb3-faf6-4575-8f2c-a938527eb6f4', 'serial': '076b8cb3-faf6-4575-8f2c-a938527eb6f4'}, 'attachment_id': 'a1e2709c-a30c-4312-aa33-548e9068770f', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:32:18 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 22:32:18 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFOKHcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:32:18 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 22:32:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:32:18 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 22:32:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:32:18 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9bd60e-1356-447e-8f22-9488d315b708]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:32:18 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b04b929-66d3-4d81-a94d-5495e2e1e3b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4] added
Nov 06 22:32:19 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f182021-58af-4d53-9937-a7994f1c947f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff0f081-9206-4de5-b4b5-9879f86cf7e6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFOKHcSp {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFOKHcSp" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e20191-524a-421e-b2ca-3c67072f42fd]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aFOKHcSp'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c632436a-3192-40dd-9590-b0bcadd06b83]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[519bd380-6440-4d92-bfdc-31a1c222de79]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG nova.network.neutron [None req-b1fa71db-2d18-44fb-b377-92f7f301233e tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updating instance_info_cache with network_info: [{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b1fa71db-2d18-44fb-b377-92f7f301233e tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Releasing lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG nova.objects.instance [None req-b1fa71db-2d18-44fb-b377-92f7f301233e tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'flavor' on Instance uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[568e5bc5-5605-49cf-8016-46bf13ed08f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260]
Nov 06 22:32:19 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260] successful.
Nov 06 22:32:19 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e7d05c-2bdf-4ab3-b8f9-55feee99cdac]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9a8365-b0ce-4137-bf25-e7418dca1cbf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:32:19 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d142b651-2ab3-4672-8b31-1e020510c30d]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFOKHcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Instance destroyed successfully.
Nov 06 22:32:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26663633037636235', 'path': '/dev/sdd'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663633037636235', 'path': '/dev/sdd'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1543740670',display_name='tempest-ServerActionsTestOtherA-server-899309665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1543740670',id=14,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmN/VyKWZXuRaaictuLTmDXlTum2xd2CWW45IjcqETXGMmR4MO8Nfu3+mUVy/T9OyJEtn7OQ4adADPNX/Sr89RqeTH93H8uReMub/zXCcqSw9dSeqiAoLDGj3NUacxE7g==',key_name='tempest-keypair-152635658',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-q79vaexu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=4367ded2-3cb6-44bc-a4a2-9b0b4bf98108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:32:20 user nova-compute[75000]:   <uuid>4367ded2-3cb6-44bc-a4a2-9b0b4bf98108</uuid>
Nov 06 22:32:20 user nova-compute[75000]:   <name>instance-0000000e</name>
Nov 06 22:32:20 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:32:20 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:32:20 user nova-compute[75000]:   <metadata>
Nov 06 22:32:20 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:32:20 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:32:20 user nova-compute[75000]:       <nova:name>tempest-ServerActionsTestOtherA-server-899309665</nova:name>
Nov 06 22:32:20 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:32:18</nova:creationTime>
Nov 06 22:32:20 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:32:20 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:32:20 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:32:20 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:32:20 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:32:20 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:32:20 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:32:20 user nova-compute[75000]:       <nova:owner>
Nov 06 22:32:20 user nova-compute[75000]:         <nova:user uuid="c6b8ec49509748aab2ab06755faf2a2d">tempest-ServerActionsTestOtherA-287714099-project-member</nova:user>
Nov 06 22:32:20 user nova-compute[75000]:         <nova:project uuid="c931a6fc1f8a405f83293c6685dc016e">tempest-ServerActionsTestOtherA-287714099</nova:project>
Nov 06 22:32:20 user nova-compute[75000]:       </nova:owner>
Nov 06 22:32:20 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:32:20 user nova-compute[75000]:       <nova:ports>
Nov 06 22:32:20 user nova-compute[75000]:         <nova:port uuid="884e3b6b-4f31-4776-9d5c-b8f64388f438">
Nov 06 22:32:20 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 22:32:20 user nova-compute[75000]:         </nova:port>
Nov 06 22:32:20 user nova-compute[75000]:       </nova:ports>
Nov 06 22:32:20 user nova-compute[75000]:     </nova:instance>
Nov 06 22:32:20 user nova-compute[75000]:   </metadata>
Nov 06 22:32:20 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:32:20 user nova-compute[75000]:     <system>
Nov 06 22:32:20 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:32:20 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:32:20 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:32:20 user nova-compute[75000]:       <entry name="serial">4367ded2-3cb6-44bc-a4a2-9b0b4bf98108</entry>
Nov 06 22:32:20 user nova-compute[75000]:       <entry name="uuid">4367ded2-3cb6-44bc-a4a2-9b0b4bf98108</entry>
Nov 06 22:32:20 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:32:20 user nova-compute[75000]:     </system>
Nov 06 22:32:20 user nova-compute[75000]:   </sysinfo>
Nov 06 22:32:20 user nova-compute[75000]:   <os>
Nov 06 22:32:20 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:32:20 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:32:20 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:32:20 user nova-compute[75000]:   </os>
Nov 06 22:32:20 user nova-compute[75000]:   <features>
Nov 06 22:32:20 user nova-compute[75000]:     <acpi/>
Nov 06 22:32:20 user nova-compute[75000]:     <apic/>
Nov 06 22:32:20 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:32:20 user nova-compute[75000]:   </features>
Nov 06 22:32:20 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:32:20 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:32:20 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:32:20 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:32:20 user nova-compute[75000]:   </clock>
Nov 06 22:32:20 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:32:20 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:32:20 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:32:20 user nova-compute[75000]:   </cpu>
Nov 06 22:32:20 user nova-compute[75000]:   <devices>
Nov 06 22:32:20 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:32:20 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:32:20 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk"/>
Nov 06 22:32:20 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:32:20 user nova-compute[75000]:     </disk>
Nov 06 22:32:20 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:32:20 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:32:20 user nova-compute[75000]:       <source dev="/dev/sdd"/>
Nov 06 22:32:20 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:32:20 user nova-compute[75000]:       <serial>076b8cb3-faf6-4575-8f2c-a938527eb6f4</serial>
Nov 06 22:32:20 user nova-compute[75000]:     </disk>
Nov 06 22:32:20 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:32:20 user nova-compute[75000]:       <mac address="fa:16:3e:c2:66:35"/>
Nov 06 22:32:20 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:32:20 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:32:20 user nova-compute[75000]:       <target dev="tap884e3b6b-4f"/>
Nov 06 22:32:20 user nova-compute[75000]:     </interface>
Nov 06 22:32:20 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:32:20 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/console.log" append="off"/>
Nov 06 22:32:20 user nova-compute[75000]:     </serial>
Nov 06 22:32:20 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:32:20 user nova-compute[75000]:     <video>
Nov 06 22:32:20 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:32:20 user nova-compute[75000]:     </video>
Nov 06 22:32:20 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:32:20 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:32:20 user nova-compute[75000]:     </rng>
Nov 06 22:32:20 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:32:20 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:32:20 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:32:20 user nova-compute[75000]:     </memballoon>
Nov 06 22:32:20 user nova-compute[75000]:   </devices>
Nov 06 22:32:20 user nova-compute[75000]: </domain>
Nov 06 22:32:20 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1543740670',display_name='tempest-ServerActionsTestOtherA-server-899309665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1543740670',id=14,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmN/VyKWZXuRaaictuLTmDXlTum2xd2CWW45IjcqETXGMmR4MO8Nfu3+mUVy/T9OyJEtn7OQ4adADPNX/Sr89RqeTH93H8uReMub/zXCcqSw9dSeqiAoLDGj3NUacxE7g==',key_name='tempest-keypair-152635658',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-q79vaexu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=4367ded2-3cb6-44bc-a4a2-9b0b4bf98108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG os_vif [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4297c4cb-1e73-518c-9144-0cba0bb0026f', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap884e3b6b-4f, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap884e3b6b-4f, col_values=(('qos', UUID('0743c9a4-3897-4b68-971d-b178151a291a')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap884e3b6b-4f, col_values=(('external_ids', {'iface-id': '884e3b6b-4f31-4776-9d5c-b8f64388f438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:66:35', 'vm-uuid': '4367ded2-3cb6-44bc-a4a2-9b0b4bf98108'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:20 user nova-compute[75000]: INFO os_vif [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f')
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-unplugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-unplugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:20 user nova-compute[75000]: WARNING nova.compute.manager [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-unplugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:20 user nova-compute[75000]: WARNING nova.compute.manager [req-40483179-fac8-455b-bf9d-986225f4ae2d req-8a88ee55-4432-4f56-b249-1057a9be8536 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:32:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No VIF found with MAC fa:16:3e:c2:66:35, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:32:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-213b5a18-754b-42ab-8f87-3628ab73acb7 req-4a6bd3d9-393d-499f-a9bf-4831691b5c8e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-213b5a18-754b-42ab-8f87-3628ab73acb7 req-4a6bd3d9-393d-499f-a9bf-4831691b5c8e service nova] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-213b5a18-754b-42ab-8f87-3628ab73acb7 req-4a6bd3d9-393d-499f-a9bf-4831691b5c8e service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-213b5a18-754b-42ab-8f87-3628ab73acb7 req-4a6bd3d9-393d-499f-a9bf-4831691b5c8e service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-213b5a18-754b-42ab-8f87-3628ab73acb7 req-4a6bd3d9-393d-499f-a9bf-4831691b5c8e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] No waiting events found dispatching network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:23 user nova-compute[75000]: WARNING nova.compute.manager [req-213b5a18-754b-42ab-8f87-3628ab73acb7 req-4a6bd3d9-393d-499f-a9bf-4831691b5c8e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received unexpected event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 for instance with vm_state active and task_state rebuild_spawning.
Nov 06 22:32:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-4175b1fe-8fbb-4f44-836a-aacf22843393 req-3bec52c2-d09a-4b6e-ae1c-81f36ac14364 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4175b1fe-8fbb-4f44-836a-aacf22843393 req-3bec52c2-d09a-4b6e-ae1c-81f36ac14364 service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4175b1fe-8fbb-4f44-836a-aacf22843393 req-3bec52c2-d09a-4b6e-ae1c-81f36ac14364 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4175b1fe-8fbb-4f44-836a-aacf22843393 req-3bec52c2-d09a-4b6e-ae1c-81f36ac14364 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-4175b1fe-8fbb-4f44-836a-aacf22843393 req-3bec52c2-d09a-4b6e-ae1c-81f36ac14364 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:23 user nova-compute[75000]: WARNING nova.compute.manager [req-4175b1fe-8fbb-4f44-836a-aacf22843393 req-3bec52c2-d09a-4b6e-ae1c-81f36ac14364 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Starting finish_revert_migration {{(pid=75000) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Start _get_guest_xml network_info=[{"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '846bf5e2-230c-419c-be77-982acc036b40', 'attached_at': '2023-11-06T22:32:24.000000', 'detached_at': '', 'volume_id': 'b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'serial': 'b12a60c7-2bb6-4f35-84f2-a15588cc9e8e'}, 'attachment_id': '2d9fcd33-80dd-458f-ae52-ca47f7cf03b1', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:32:24 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:32:24 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.objects.instance [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lazy-loading 'vcpu_model' on Instance uuid 846bf5e2-230c-419c-be77-982acc036b40 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:32:24 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:32:24 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:32:24 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b0d39f-10d2-494b-9a28-5a147af6e3c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:32:24 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c800ce9a-c630-4849-967e-ec8bd76af140]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e] added
Nov 06 22:32:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[174e2486-ca45-4dbd-a8a3-eba2e48e5be0]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe1656-0ba6-4914-96fc-1511715d7460]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wopgvcrh {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wopgvcrh" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4108b68d-3201-4b52-bf6f-dd51fee5498a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wopgvcrh'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[962dcb92-8528-455c-b68d-91671ab0bcd1]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dab999a-d21d-4355-980c-888822e812f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4b3c37-47dc-4e91-8001-34a61fc6a891]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]
Nov 06 22:32:24 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.
Nov 06 22:32:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[511d6708-ed5c-43c6-a9fb-d60a135eace3]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec27fd14-8b7f-480a-94b8-3670ca29b35e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:32:24 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:32:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:32:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1de2599-5138-4c98-816b-c53ff96f0fab]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-eadbfbac-9818-4b09-953d-b5240d3f4045 req-9bcb8c37-0b6e-4b31-9dec-452e36e0bd5a service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-eadbfbac-9818-4b09-953d-b5240d3f4045 req-9bcb8c37-0b6e-4b31-9dec-452e36e0bd5a service nova] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-eadbfbac-9818-4b09-953d-b5240d3f4045 req-9bcb8c37-0b6e-4b31-9dec-452e36e0bd5a service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-eadbfbac-9818-4b09-953d-b5240d3f4045 req-9bcb8c37-0b6e-4b31-9dec-452e36e0bd5a service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-eadbfbac-9818-4b09-953d-b5240d3f4045 req-9bcb8c37-0b6e-4b31-9dec-452e36e0bd5a service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] No waiting events found dispatching network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:25 user nova-compute[75000]: WARNING nova.compute.manager [req-eadbfbac-9818-4b09-953d-b5240d3f4045 req-9bcb8c37-0b6e-4b31-9dec-452e36e0bd5a service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received unexpected event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 for instance with vm_state active and task_state rebuild_spawning.
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-8d0df8b4-7fcc-412e-8bdc-0f2673aaa83b req-2c5ad1b1-7f9a-4ffd-b687-c16ddf768904 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8d0df8b4-7fcc-412e-8bdc-0f2673aaa83b req-2c5ad1b1-7f9a-4ffd-b687-c16ddf768904 service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8d0df8b4-7fcc-412e-8bdc-0f2673aaa83b req-2c5ad1b1-7f9a-4ffd-b687-c16ddf768904 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8d0df8b4-7fcc-412e-8bdc-0f2673aaa83b req-2c5ad1b1-7f9a-4ffd-b687-c16ddf768904 service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-8d0df8b4-7fcc-412e-8bdc-0f2673aaa83b req-2c5ad1b1-7f9a-4ffd-b687-c16ddf768904 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:25 user nova-compute[75000]: WARNING nova.compute.manager [req-8d0df8b4-7fcc-412e-8bdc-0f2673aaa83b req-2c5ad1b1-7f9a-4ffd-b687-c16ddf768904 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:32:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:32:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Instance spawned successfully.
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b1fa71db-2d18-44fb-b377-92f7f301233e tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75000) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23464613137396432', 'path': '/dev/sdg'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464613137396432', 'path': '/dev/sdg'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a27599cb-ce41-4ffe-b35a-28ffe0978fbe tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.101s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-410044661',display_name='tempest-ServerActionsTestOtherB-server-410044661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-410044661',id=6,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN127j9rMCzJhcsyMMnA9oMyDSW626YDveQjSPb2IR7mcffJ8blZhWvgtIPRXJ9KDmmNRktgeSU8SDicFRInDOK2YoxINbUZ+i2iHac2q1b7ra/rMkxI3W72lm49ZRgf7w==',key_name='tempest-keypair-1677332467',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:30:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54eb33cd621c4fa78fead18be74916ee',ramdisk_id='',reservation_id='r-nlmmujhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-408033839',owner_user_name='tempest-ServerActionsTestOtherB-408033839-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8b116c4cb154ce0a1a80045258cd123',uuid=846bf5e2-230c-419c-be77-982acc036b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converting VIF {"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:32:26 user nova-compute[75000]:   <uuid>846bf5e2-230c-419c-be77-982acc036b40</uuid>
Nov 06 22:32:26 user nova-compute[75000]:   <name>instance-00000006</name>
Nov 06 22:32:26 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:32:26 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:32:26 user nova-compute[75000]:   <metadata>
Nov 06 22:32:26 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:32:26 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:32:26 user nova-compute[75000]:       <nova:name>tempest-ServerActionsTestOtherB-server-410044661</nova:name>
Nov 06 22:32:26 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:32:24</nova:creationTime>
Nov 06 22:32:26 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:32:26 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:32:26 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:32:26 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:32:26 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:32:26 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:32:26 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:32:26 user nova-compute[75000]:       <nova:owner>
Nov 06 22:32:26 user nova-compute[75000]:         <nova:user uuid="c8b116c4cb154ce0a1a80045258cd123">tempest-ServerActionsTestOtherB-408033839-project-member</nova:user>
Nov 06 22:32:26 user nova-compute[75000]:         <nova:project uuid="54eb33cd621c4fa78fead18be74916ee">tempest-ServerActionsTestOtherB-408033839</nova:project>
Nov 06 22:32:26 user nova-compute[75000]:       </nova:owner>
Nov 06 22:32:26 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:32:26 user nova-compute[75000]:       <nova:ports>
Nov 06 22:32:26 user nova-compute[75000]:         <nova:port uuid="f6cb1907-7cf4-46fd-9526-9c885c806ce2">
Nov 06 22:32:26 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 22:32:26 user nova-compute[75000]:         </nova:port>
Nov 06 22:32:26 user nova-compute[75000]:       </nova:ports>
Nov 06 22:32:26 user nova-compute[75000]:     </nova:instance>
Nov 06 22:32:26 user nova-compute[75000]:   </metadata>
Nov 06 22:32:26 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:32:26 user nova-compute[75000]:     <system>
Nov 06 22:32:26 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:32:26 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:32:26 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:32:26 user nova-compute[75000]:       <entry name="serial">846bf5e2-230c-419c-be77-982acc036b40</entry>
Nov 06 22:32:26 user nova-compute[75000]:       <entry name="uuid">846bf5e2-230c-419c-be77-982acc036b40</entry>
Nov 06 22:32:26 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:32:26 user nova-compute[75000]:     </system>
Nov 06 22:32:26 user nova-compute[75000]:   </sysinfo>
Nov 06 22:32:26 user nova-compute[75000]:   <os>
Nov 06 22:32:26 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:32:26 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:32:26 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:32:26 user nova-compute[75000]:   </os>
Nov 06 22:32:26 user nova-compute[75000]:   <features>
Nov 06 22:32:26 user nova-compute[75000]:     <acpi/>
Nov 06 22:32:26 user nova-compute[75000]:     <apic/>
Nov 06 22:32:26 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:32:26 user nova-compute[75000]:   </features>
Nov 06 22:32:26 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:32:26 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:32:26 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:32:26 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:32:26 user nova-compute[75000]:   </clock>
Nov 06 22:32:26 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:32:26 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:32:26 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:32:26 user nova-compute[75000]:   </cpu>
Nov 06 22:32:26 user nova-compute[75000]:   <devices>
Nov 06 22:32:26 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:32:26 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:32:26 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk"/>
Nov 06 22:32:26 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:32:26 user nova-compute[75000]:     </disk>
Nov 06 22:32:26 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:32:26 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:32:26 user nova-compute[75000]:       <source dev="/dev/sdg"/>
Nov 06 22:32:26 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:32:26 user nova-compute[75000]:       <serial>b12a60c7-2bb6-4f35-84f2-a15588cc9e8e</serial>
Nov 06 22:32:26 user nova-compute[75000]:     </disk>
Nov 06 22:32:26 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:32:26 user nova-compute[75000]:       <mac address="fa:16:3e:4f:6d:94"/>
Nov 06 22:32:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:32:26 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:32:26 user nova-compute[75000]:       <target dev="tapf6cb1907-7c"/>
Nov 06 22:32:26 user nova-compute[75000]:     </interface>
Nov 06 22:32:26 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:32:26 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/console.log" append="off"/>
Nov 06 22:32:26 user nova-compute[75000]:     </serial>
Nov 06 22:32:26 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:32:26 user nova-compute[75000]:     <video>
Nov 06 22:32:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:32:26 user nova-compute[75000]:     </video>
Nov 06 22:32:26 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:32:26 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:32:26 user nova-compute[75000]:     </rng>
Nov 06 22:32:26 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:32:26 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:32:26 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:32:26 user nova-compute[75000]:     </memballoon>
Nov 06 22:32:26 user nova-compute[75000]:   </devices>
Nov 06 22:32:26 user nova-compute[75000]: </domain>
Nov 06 22:32:26 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-410044661',display_name='tempest-ServerActionsTestOtherB-server-410044661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-410044661',id=6,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN127j9rMCzJhcsyMMnA9oMyDSW626YDveQjSPb2IR7mcffJ8blZhWvgtIPRXJ9KDmmNRktgeSU8SDicFRInDOK2YoxINbUZ+i2iHac2q1b7ra/rMkxI3W72lm49ZRgf7w==',key_name='tempest-keypair-1677332467',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:30:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54eb33cd621c4fa78fead18be74916ee',ramdisk_id='',reservation_id='r-nlmmujhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-408033839',owner_user_name='tempest-ServerActionsTestOtherB-408033839-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8b116c4cb154ce0a1a80045258cd123',uuid=846bf5e2-230c-419c-be77-982acc036b40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converting VIF {"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG os_vif [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fc03e8f-ec08-5990-a9eb-0217578c15b2', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6cb1907-7c, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6cb1907-7c, col_values=(('qos', UUID('2dcebee4-5cbf-4502-b952-9840f46e878b')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6cb1907-7c, col_values=(('external_ids', {'iface-id': 'f6cb1907-7cf4-46fd-9526-9c885c806ce2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:6d:94', 'vm-uuid': '846bf5e2-230c-419c-be77-982acc036b40'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:26 user nova-compute[75000]: INFO os_vif [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c')
Nov 06 22:32:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:27 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:32:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-6f483d48-32ff-4a43-af83-4844b0090134 req-5577c1cc-2cc0-4cb3-aebc-d004971c36b6 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6f483d48-32ff-4a43-af83-4844b0090134 req-5577c1cc-2cc0-4cb3-aebc-d004971c36b6 service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6f483d48-32ff-4a43-af83-4844b0090134 req-5577c1cc-2cc0-4cb3-aebc-d004971c36b6 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6f483d48-32ff-4a43-af83-4844b0090134 req-5577c1cc-2cc0-4cb3-aebc-d004971c36b6 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-6f483d48-32ff-4a43-af83-4844b0090134 req-5577c1cc-2cc0-4cb3-aebc-d004971c36b6 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:28 user nova-compute[75000]: WARNING nova.compute.manager [req-6f483d48-32ff-4a43-af83-4844b0090134 req-5577c1cc-2cc0-4cb3-aebc-d004971c36b6 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state resized and task_state resize_reverting.
Nov 06 22:32:28 user nova-compute[75000]: INFO nova.virt.block_device [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Booting with volume 0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 at /dev/vdb
Nov 06 22:32:28 user nova-compute[75000]: DEBUG os_brick.utils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[10501dc0-97f6-4026-a2bb-d46dee4ee805]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfa717f-2ae4-425b-99ca-0cc37a3110c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0526bd-4996-4dec-bc0c-2bbc2c71f3c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c4d5f7-da08-4e7d-aafd-315f8377abec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:32:28 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[939d60d0-ba85-48eb-9714-e95a0d79730a]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG os_brick.utils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating existing volume attachment record: 6c837493-b03b-42f1-8d37-3f8046e40c32 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-c24afb5e-dd09-4189-a242-5cb4d9e25e45 req-d375256d-4d34-45ab-ba35-7789d514a2bd service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c24afb5e-dd09-4189-a242-5cb4d9e25e45 req-d375256d-4d34-45ab-ba35-7789d514a2bd service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c24afb5e-dd09-4189-a242-5cb4d9e25e45 req-d375256d-4d34-45ab-ba35-7789d514a2bd service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c24afb5e-dd09-4189-a242-5cb4d9e25e45 req-d375256d-4d34-45ab-ba35-7789d514a2bd service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-c24afb5e-dd09-4189-a242-5cb4d9e25e45 req-d375256d-4d34-45ab-ba35-7789d514a2bd service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:32:30 user nova-compute[75000]: WARNING nova.compute.manager [req-c24afb5e-dd09-4189-a242-5cb4d9e25e45 req-d375256d-4d34-45ab-ba35-7789d514a2bd service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state resized and task_state resize_reverting.
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG nova.compute.manager [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:30 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance running successfully.
Nov 06 22:32:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] finish_revert_migration finished successfully. {{(pid=75000) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:31 user nova-compute[75000]: INFO nova.compute.manager [None req-84ed1b2e-a3ec-44a2-8bf8-12bada245b91 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance to original state: 'active'
Nov 06 22:32:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:32:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:34 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:32:34 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:32:34 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7496MB free_disk=25.224029541015625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:32:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:32:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c9422249-ff7a-455e-87e1-bdce3e0345f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 846bf5e2-230c-419c-be77-982acc036b40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0414d03a-aba0-44df-9cca-257ab81bde61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance e5501afd-b133-451c-b16e-3f03b22cdf66 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 98957082-bdb6-472c-9462-f3e8d7340a20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:32:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.764s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:32:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:32:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:32:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 22:32:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:32:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:32:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:32:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:32:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:32:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:32:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:55 user nova-compute[75000]: INFO nova.virt.block_device [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Booting with volume ff7647fd-5314-4376-b166-994b9ca3e320 at /dev/vdc
Nov 06 22:32:55 user nova-compute[75000]: DEBUG os_brick.utils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf97633-643b-45d5-b829-b7506db0f4c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a154d44-4c33-4975-9249-15a02580c671]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7c0bbe-11c3-4d97-966d-4d80d69c9351]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c887e-ac2f-48f6-9cbc-65993f4325de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:32:55 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:32:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[391493bc-78c0-41c4-aecc-8ca2e5b8b324]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG os_brick.utils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:32:55 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating existing volume attachment record: 8f90fb91-bc9b-414f-b533-29e3f2e902e3 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:32:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c5590d2-b6d4-4ecc-bc4a-ad4bc5b7529b req-951e2c48-8894-4b0d-8dfb-930d90c12c91 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received event network-changed-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:32:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c5590d2-b6d4-4ecc-bc4a-ad4bc5b7529b req-951e2c48-8894-4b0d-8dfb-930d90c12c91 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Refreshing instance network info cache due to event network-changed-23d18ab8-4f29-4708-87c9-a59ce954842b. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:32:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c5590d2-b6d4-4ecc-bc4a-ad4bc5b7529b req-951e2c48-8894-4b0d-8dfb-930d90c12c91 service nova] Acquiring lock "refresh_cache-0414d03a-aba0-44df-9cca-257ab81bde61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:32:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c5590d2-b6d4-4ecc-bc4a-ad4bc5b7529b req-951e2c48-8894-4b0d-8dfb-930d90c12c91 service nova] Acquired lock "refresh_cache-0414d03a-aba0-44df-9cca-257ab81bde61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:32:56 user nova-compute[75000]: DEBUG nova.network.neutron [req-2c5590d2-b6d4-4ecc-bc4a-ad4bc5b7529b req-951e2c48-8894-4b0d-8dfb-930d90c12c91 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Refreshing network info cache for port 23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:32:57 user nova-compute[75000]: DEBUG nova.network.neutron [req-2c5590d2-b6d4-4ecc-bc4a-ad4bc5b7529b req-951e2c48-8894-4b0d-8dfb-930d90c12c91 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Updated VIF entry in instance network info cache for port 23d18ab8-4f29-4708-87c9-a59ce954842b. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:32:57 user nova-compute[75000]: DEBUG nova.network.neutron [req-2c5590d2-b6d4-4ecc-bc4a-ad4bc5b7529b req-951e2c48-8894-4b0d-8dfb-930d90c12c91 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Updating instance_info_cache with network_info: [{"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:32:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c5590d2-b6d4-4ecc-bc4a-ad4bc5b7529b req-951e2c48-8894-4b0d-8dfb-930d90c12c91 service nova] Releasing lock "refresh_cache-0414d03a-aba0-44df-9cca-257ab81bde61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:32:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:32:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:00 user nova-compute[75000]: INFO nova.compute.manager [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Terminating instance
Nov 06 22:33:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG nova.compute.manager [req-8b9cdcf7-e07f-462b-8aab-ab5a6fe0fdc0 req-20fc842b-77c5-42e8-8d14-21560f343d09 service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received event network-vif-unplugged-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8b9cdcf7-e07f-462b-8aab-ab5a6fe0fdc0 req-20fc842b-77c5-42e8-8d14-21560f343d09 service nova] Acquiring lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8b9cdcf7-e07f-462b-8aab-ab5a6fe0fdc0 req-20fc842b-77c5-42e8-8d14-21560f343d09 service nova] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8b9cdcf7-e07f-462b-8aab-ab5a6fe0fdc0 req-20fc842b-77c5-42e8-8d14-21560f343d09 service nova] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG nova.compute.manager [req-8b9cdcf7-e07f-462b-8aab-ab5a6fe0fdc0 req-20fc842b-77c5-42e8-8d14-21560f343d09 service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] No waiting events found dispatching network-vif-unplugged-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:00 user nova-compute[75000]: DEBUG nova.compute.manager [req-8b9cdcf7-e07f-462b-8aab-ab5a6fe0fdc0 req-20fc842b-77c5-42e8-8d14-21560f343d09 service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received event network-vif-unplugged-7e1bca9c-0bae-4e25-a63e-444758f9569b for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Instance destroyed successfully.
Nov 06 22:33:01 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lazy-loading 'resources' on Instance uuid a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:31:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1594553101',display_name='tempest-VolumesActionsTest-instance-1594553101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1594553101',id=18,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:31:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8f0e789571a4a63b90b26c9a5b0c954',ramdisk_id='',reservation_id='r-urmhkc1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-297854992',owner_user_name='tempest-VolumesActionsTest-297854992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:17Z,user_data=None,user_id='afc6c795f94d4469825b1ceac5bb2ccb',uuid=a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converting VIF {"id": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "address": "fa:16:3e:ff:12:51", "network": {"id": "1f9edb97-05ac-46e7-985a-338d88906094", "bridge": "br-int", "label": "tempest-VolumesActionsTest-938134290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8f0e789571a4a63b90b26c9a5b0c954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e1bca9c-0b", "ovs_interfaceid": "7e1bca9c-0bae-4e25-a63e-444758f9569b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:12:51,bridge_name='br-int',has_traffic_filtering=True,id=7e1bca9c-0bae-4e25-a63e-444758f9569b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1bca9c-0b') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG os_vif [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:12:51,bridge_name='br-int',has_traffic_filtering=True,id=7e1bca9c-0bae-4e25-a63e-444758f9569b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1bca9c-0b') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e1bca9c-0b, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cbb289a-cf2d-4966-a96c-2cbd51e9d0b4) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:01 user nova-compute[75000]: INFO os_vif [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:12:51,bridge_name='br-int',has_traffic_filtering=True,id=7e1bca9c-0bae-4e25-a63e-444758f9569b,network=Network(1f9edb97-05ac-46e7-985a-338d88906094),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e1bca9c-0b')
Nov 06 22:33:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Deleting instance files /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff_del
Nov 06 22:33:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Deletion of /opt/stack/data/nova/instances/a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff_del complete
Nov 06 22:33:01 user nova-compute[75000]: INFO nova.compute.manager [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 22:33:01 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:33:01 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:33:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-e44ef5a6-798c-4490-a5d5-003a8faa7f9a req-e15be9d6-808a-4212-876b-4dc7af57d17e service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received event network-vif-deleted-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:02 user nova-compute[75000]: INFO nova.compute.manager [req-e44ef5a6-798c-4490-a5d5-003a8faa7f9a req-e15be9d6-808a-4212-876b-4dc7af57d17e service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Neutron deleted interface 7e1bca9c-0bae-4e25-a63e-444758f9569b; detaching it from the instance and deleting it from the info cache
Nov 06 22:33:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-e44ef5a6-798c-4490-a5d5-003a8faa7f9a req-e15be9d6-808a-4212-876b-4dc7af57d17e service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:02 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:02 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Took 0.74 seconds to deallocate network for instance.
Nov 06 22:33:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-e44ef5a6-798c-4490-a5d5-003a8faa7f9a req-e15be9d6-808a-4212-876b-4dc7af57d17e service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Detach interface failed, port_id=7e1bca9c-0bae-4e25-a63e-444758f9569b, reason: Instance a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:33:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:02 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:33:02 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:33:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:02 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Deleted allocations for instance a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff
Nov 06 22:33:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0129cced-ad47-46d1-80d7-cba16caaab18 tempest-VolumesActionsTest-297854992 tempest-VolumesActionsTest-297854992-project-member] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.469s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-10c3d50f-3e64-4ff4-b8bf-74b20cf90dd3 req-0930892e-0456-4b3b-aed8-938aac1b9771 service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received event network-vif-plugged-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10c3d50f-3e64-4ff4-b8bf-74b20cf90dd3 req-0930892e-0456-4b3b-aed8-938aac1b9771 service nova] Acquiring lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10c3d50f-3e64-4ff4-b8bf-74b20cf90dd3 req-0930892e-0456-4b3b-aed8-938aac1b9771 service nova] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10c3d50f-3e64-4ff4-b8bf-74b20cf90dd3 req-0930892e-0456-4b3b-aed8-938aac1b9771 service nova] Lock "a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-10c3d50f-3e64-4ff4-b8bf-74b20cf90dd3 req-0930892e-0456-4b3b-aed8-938aac1b9771 service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] No waiting events found dispatching network-vif-plugged-7e1bca9c-0bae-4e25-a63e-444758f9569b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:03 user nova-compute[75000]: WARNING nova.compute.manager [req-10c3d50f-3e64-4ff4-b8bf-74b20cf90dd3 req-0930892e-0456-4b3b-aed8-938aac1b9771 service nova] [instance: a789ad9b-8e4a-4bb3-96b8-ca71e02df4ff] Received unexpected event network-vif-plugged-7e1bca9c-0bae-4e25-a63e-444758f9569b for instance with vm_state deleted and task_state None.
Nov 06 22:33:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG nova.objects.instance [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lazy-loading 'flavor' on Instance uuid 0414d03a-aba0-44df-9cca-257ab81bde61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.123s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:03 user nova-compute[75000]: INFO nova.compute.manager [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Attaching volume 7e0cfc65-a19c-4443-8f7d-21d28214de69 to /dev/vdb
Nov 06 22:33:04 user nova-compute[75000]: DEBUG os_brick.utils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4f4ab0-6270-4c42-8df1-f78f6943bb90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a79367-8b55-42fa-814d-e2a1be92ac26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9c99cb-59ed-4966-89b1-9a21f42bc45a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec897ca-ba11-4eba-88de-732012315858]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:33:04 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:33:04 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[98053df4-ff4b-4e76-81a4-d47a3799ae0d]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG os_brick.utils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Updating existing volume attachment record: ce8a226c-c49f-40eb-84ef-addafe990fc0 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:33:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:33:06 user nova-compute[75000]: INFO nova.compute.claims [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Claim successful on node user
Nov 06 22:33:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:33:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.policy [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9adf42a2f6ae4b83900ab310933a6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '425b4940d7904d58982aae5a883fc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:33:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Creating image(s)
Nov 06 22:33:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "/opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "/opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "/opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.205s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk 1073741824" returned: 0 in 0.263s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.464s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Successfully created port: 78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Cannot resize image /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Ensure instance console log exists: /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Successfully updated port: 78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquired lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-89341afd-27c9-4b35-8159-f65c89371a93 req-86e53977-a9c5-4ba3-81d4-0c01f3b150f3 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-changed-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-89341afd-27c9-4b35-8159-f65c89371a93 req-86e53977-a9c5-4ba3-81d4-0c01f3b150f3 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Refreshing instance network info cache due to event network-changed-78f02e5b-8e34-4d73-907b-c49095cc8147. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-89341afd-27c9-4b35-8159-f65c89371a93 req-86e53977-a9c5-4ba3-81d4-0c01f3b150f3 service nova] Acquiring lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updating instance_info_cache with network_info: [{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Releasing lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance network_info: |[{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-89341afd-27c9-4b35-8159-f65c89371a93 req-86e53977-a9c5-4ba3-81d4-0c01f3b150f3 service nova] Acquired lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-89341afd-27c9-4b35-8159-f65c89371a93 req-86e53977-a9c5-4ba3-81d4-0c01f3b150f3 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Refreshing network info cache for port 78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Start _get_guest_xml network_info=[{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:33:08 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:33:08 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953138957',display_name='tempest-AttachVolumeTestJSON-server-1953138957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953138957',id=21,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKYUG+wX+Oy+5ZoCKABFPtVTS7CC7ezeu/QxRZrCFggdt3WxIBlw/f9Sjy6ccYGHltY5PMTkclfZi01PiCR7pnVT8WAyKEH2jdwmIpQmqFPlb4e6rSMVTU80G2v7DaTuQ==',key_name='tempest-keypair-458501348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-r3alv0me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:33:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=16b393b8-83f7-4a36-9de2-f8c230c94be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.objects.instance [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'pci_devices' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:33:08 user nova-compute[75000]:   <uuid>16b393b8-83f7-4a36-9de2-f8c230c94be5</uuid>
Nov 06 22:33:08 user nova-compute[75000]:   <name>instance-00000015</name>
Nov 06 22:33:08 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:33:08 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:33:08 user nova-compute[75000]:   <metadata>
Nov 06 22:33:08 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:33:08 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:33:08 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeTestJSON-server-1953138957</nova:name>
Nov 06 22:33:08 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:33:08</nova:creationTime>
Nov 06 22:33:08 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:33:08 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:33:08 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:33:08 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:33:08 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:33:08 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:33:08 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:33:08 user nova-compute[75000]:       <nova:owner>
Nov 06 22:33:08 user nova-compute[75000]:         <nova:user uuid="9adf42a2f6ae4b83900ab310933a6421">tempest-AttachVolumeTestJSON-738638018-project-member</nova:user>
Nov 06 22:33:08 user nova-compute[75000]:         <nova:project uuid="425b4940d7904d58982aae5a883fc3ed">tempest-AttachVolumeTestJSON-738638018</nova:project>
Nov 06 22:33:08 user nova-compute[75000]:       </nova:owner>
Nov 06 22:33:08 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:33:08 user nova-compute[75000]:       <nova:ports>
Nov 06 22:33:08 user nova-compute[75000]:         <nova:port uuid="78f02e5b-8e34-4d73-907b-c49095cc8147">
Nov 06 22:33:08 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:33:08 user nova-compute[75000]:         </nova:port>
Nov 06 22:33:08 user nova-compute[75000]:       </nova:ports>
Nov 06 22:33:08 user nova-compute[75000]:     </nova:instance>
Nov 06 22:33:08 user nova-compute[75000]:   </metadata>
Nov 06 22:33:08 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:33:08 user nova-compute[75000]:     <system>
Nov 06 22:33:08 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:33:08 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:33:08 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:33:08 user nova-compute[75000]:       <entry name="serial">16b393b8-83f7-4a36-9de2-f8c230c94be5</entry>
Nov 06 22:33:08 user nova-compute[75000]:       <entry name="uuid">16b393b8-83f7-4a36-9de2-f8c230c94be5</entry>
Nov 06 22:33:08 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:33:08 user nova-compute[75000]:     </system>
Nov 06 22:33:08 user nova-compute[75000]:   </sysinfo>
Nov 06 22:33:08 user nova-compute[75000]:   <os>
Nov 06 22:33:08 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:33:08 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:33:08 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:33:08 user nova-compute[75000]:   </os>
Nov 06 22:33:08 user nova-compute[75000]:   <features>
Nov 06 22:33:08 user nova-compute[75000]:     <acpi/>
Nov 06 22:33:08 user nova-compute[75000]:     <apic/>
Nov 06 22:33:08 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:33:08 user nova-compute[75000]:   </features>
Nov 06 22:33:08 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:33:08 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:33:08 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:33:08 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:33:08 user nova-compute[75000]:   </clock>
Nov 06 22:33:08 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:33:08 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:33:08 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:33:08 user nova-compute[75000]:   </cpu>
Nov 06 22:33:08 user nova-compute[75000]:   <devices>
Nov 06 22:33:08 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:33:08 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:33:08 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk"/>
Nov 06 22:33:08 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:33:08 user nova-compute[75000]:     </disk>
Nov 06 22:33:08 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:33:08 user nova-compute[75000]:       <mac address="fa:16:3e:a0:b0:4e"/>
Nov 06 22:33:08 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:08 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:33:08 user nova-compute[75000]:       <target dev="tap78f02e5b-8e"/>
Nov 06 22:33:08 user nova-compute[75000]:     </interface>
Nov 06 22:33:08 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:33:08 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/console.log" append="off"/>
Nov 06 22:33:08 user nova-compute[75000]:     </serial>
Nov 06 22:33:08 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:33:08 user nova-compute[75000]:     <video>
Nov 06 22:33:08 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:08 user nova-compute[75000]:     </video>
Nov 06 22:33:08 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:33:08 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:33:08 user nova-compute[75000]:     </rng>
Nov 06 22:33:08 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:33:08 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:33:08 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:33:08 user nova-compute[75000]:     </memballoon>
Nov 06 22:33:08 user nova-compute[75000]:   </devices>
Nov 06 22:33:08 user nova-compute[75000]: </domain>
Nov 06 22:33:08 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953138957',display_name='tempest-AttachVolumeTestJSON-server-1953138957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953138957',id=21,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKYUG+wX+Oy+5ZoCKABFPtVTS7CC7ezeu/QxRZrCFggdt3WxIBlw/f9Sjy6ccYGHltY5PMTkclfZi01PiCR7pnVT8WAyKEH2jdwmIpQmqFPlb4e6rSMVTU80G2v7DaTuQ==',key_name='tempest-keypair-458501348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-r3alv0me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:33:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=16b393b8-83f7-4a36-9de2-f8c230c94be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG os_vif [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '442fe7f0-a6f0-54e3-85ee-c3679aceb66c', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78f02e5b-8e, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78f02e5b-8e, col_values=(('qos', UUID('1c1f766a-00e9-43e1-a525-ebc6096c9edf')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78f02e5b-8e, col_values=(('external_ids', {'iface-id': '78f02e5b-8e34-4d73-907b-c49095cc8147', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:b0:4e', 'vm-uuid': '16b393b8-83f7-4a36-9de2-f8c230c94be5'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:08 user nova-compute[75000]: INFO os_vif [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e')
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No VIF found with MAC fa:16:3e:a0:b0:4e, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-89341afd-27c9-4b35-8159-f65c89371a93 req-86e53977-a9c5-4ba3-81d4-0c01f3b150f3 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updated VIF entry in instance network info cache for port 78f02e5b-8e34-4d73-907b-c49095cc8147. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:33:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-89341afd-27c9-4b35-8159-f65c89371a93 req-86e53977-a9c5-4ba3-81d4-0c01f3b150f3 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updating instance_info_cache with network_info: [{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-89341afd-27c9-4b35-8159-f65c89371a93 req-86e53977-a9c5-4ba3-81d4-0c01f3b150f3 service nova] Releasing lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:33:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-3ba710d3-7d5f-47f3-996c-ecaf3e873435 req-76c52409-4338-44a0-9aa9-915a497aa6d6 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3ba710d3-7d5f-47f3-996c-ecaf3e873435 req-76c52409-4338-44a0-9aa9-915a497aa6d6 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3ba710d3-7d5f-47f3-996c-ecaf3e873435 req-76c52409-4338-44a0-9aa9-915a497aa6d6 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3ba710d3-7d5f-47f3-996c-ecaf3e873435 req-76c52409-4338-44a0-9aa9-915a497aa6d6 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-3ba710d3-7d5f-47f3-996c-ecaf3e873435 req-76c52409-4338-44a0-9aa9-915a497aa6d6 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:10 user nova-compute[75000]: WARNING nova.compute.manager [req-3ba710d3-7d5f-47f3-996c-ecaf3e873435 req-76c52409-4338-44a0-9aa9-915a497aa6d6 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state building and task_state spawning.
Nov 06 22:33:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-47c281ae-3562-4de1-9048-c0fea17daf9a req-90e17c7a-e9ed-4481-aa71-af1553afc8ef service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-47c281ae-3562-4de1-9048-c0fea17daf9a req-90e17c7a-e9ed-4481-aa71-af1553afc8ef service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-47c281ae-3562-4de1-9048-c0fea17daf9a req-90e17c7a-e9ed-4481-aa71-af1553afc8ef service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-47c281ae-3562-4de1-9048-c0fea17daf9a req-90e17c7a-e9ed-4481-aa71-af1553afc8ef service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-47c281ae-3562-4de1-9048-c0fea17daf9a req-90e17c7a-e9ed-4481-aa71-af1553afc8ef service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:12 user nova-compute[75000]: WARNING nova.compute.manager [req-47c281ae-3562-4de1-9048-c0fea17daf9a req-90e17c7a-e9ed-4481-aa71-af1553afc8ef service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state building and task_state spawning.
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:33:12 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance spawned successfully.
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:12 user nova-compute[75000]: INFO nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 06 22:33:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:33:12 user nova-compute[75000]: INFO nova.compute.manager [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Took 7.01 seconds to build instance.
Nov 06 22:33:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-28f030b4-128e-4813-8496-554daca8176d tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.119s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:33:23 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Creating image(s)
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Ensure instance console log exists: /opt/stack/data/nova/instances/e5501afd-b133-451c-b16e-3f03b22cdf66/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Start _get_guest_xml network_info=[{"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkhiJDqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5501afd-b133-451c-b16e-3f03b22cdf66', 'attached_at': '', 'detached_at': '', 'volume_id': '51516dc7-babc-4eda-866e-0245b93bdec0', 'serial': '51516dc7-babc-4eda-866e-0245b93bdec0'}, 'attachment_id': '5e1e7540-363f-4643-b545-a056e093a0f5', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCNPFvpc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5501afd-b133-451c-b16e-3f03b22cdf66', 'attached_at': '', 'detached_at': '', 'volume_id': '0dbd0369-23b5-4036-be4a-fcf6ba4c9b76', 'serial': '0dbd0369-23b5-4036-be4a-fcf6ba4c9b76'}, 'attachment_id': '6c837493-b03b-42f1-8d37-3f8046e40c32', 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjeoGugH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5501afd-b133-451c-b16e-3f03b22cdf66', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff7647fd-5314-4376-b166-994b9ca3e320', 'serial': 'ff7647fd-5314-4376-b166-994b9ca3e320'}, 'attachment_id': '8f90fb91-bc9b-414f-b533-29e3f2e902e3', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:33:23 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:33:23 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkhiJDqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:33:23 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:23 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:23 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aa9700-3f97-48f2-955b-68f3ff7e3779]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:33:23 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0732b8e5-3d34-4a85-8601-2015040c727c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0] added
Nov 06 22:33:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfefe89c-c740-4682-9087-7deb185673ff]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1271b800-8e61-42d4-b1a5-2c5f22fd2eeb]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkhiJDqw {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkhiJDqw" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0425c192-c469-4d63-83c0-3b30da31ad41]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CkhiJDqw'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12ff636-a564-466c-8fe4-7b5fcb68e758]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1933be90-9e73-4f63-9057-bee903d973c0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c040750-b4ae-4ab9-b079-bcbfdfac5aa6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0, portal: 172.16.0.220,3260]
Nov 06 22:33:23 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0, portal: 172.16.0.220,3260] successful.
Nov 06 22:33:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2573bccc-b626-41a6-998a-7a0f45b1a5e9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f81d0-c179-4c73-b930-77ae7017b0cc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d9b168-8e21-4dc2-a2af-e42b1423cd1a]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:23 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkhiJDqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26162633735303035', 'path': '/dev/sdh'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162633735303035', 'path': '/dev/sdh'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCNPFvpc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:33:24 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:24 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:24 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94886d1-a672-4e26-8639-099176fa4f01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:33:24 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[419df3f0-863c-45fc-b593-91098a56be7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76] added
Nov 06 22:33:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac6b9f5-65db-42d1-a8cf-413ec2392959]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[77454788-1a9b-442b-a442-28a747634f31]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZCNPFvpc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZCNPFvpc" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce01f18-41f0-47ea-96e4-9ec643ee56cc]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZCNPFvpc'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c669996-77d7-498d-baee-e95236d574ff]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ab14dd-bc38-48a9-90cb-e8af28969614]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[801df3f5-8081-4498-bf33-1ca0bf4c0e7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76, portal: 172.16.0.220,3260]
Nov 06 22:33:25 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76, portal: 172.16.0.220,3260] successful.
Nov 06 22:33:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f5847e-c3ef-414d-9874-bc7b8a508d33]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b2e56b-e7b2-462e-bd17-49ece4bec4d7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddca273-fb9c-48a6-a68f-c70fa966819c]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:33:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCNPFvpc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23061363661393435', 'path': '/dev/sdi'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061363661393435', 'path': '/dev/sdi'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjeoGugH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:33:26 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:26 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:26 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb11f248-de9e-45e7-8d66-ce231946bf25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:33:26 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b194fe-e5ae-4d4f-8151-72b0f7397436]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320] added
Nov 06 22:33:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a16ebf-ee51-4618-8426-2decbecdcb97]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee50b4a-e337-4a40-b106-834e424bf58f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sjeoGugH {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sjeoGugH" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3643d78a-8efa-45cc-99ee-af4d1723ee7e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sjeoGugH'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f844e879-8b45-44fa-a279-83330c6f17b8]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d3994-744d-445c-ac1e-6f467ab6701f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc1e4e2-59c8-486a-8ec0-0697209844a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320, portal: 172.16.0.220,3260]
Nov 06 22:33:26 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320, portal: 172.16.0.220,3260] successful.
Nov 06 22:33:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[986e250a-8c06-49b5-892d-54502575851b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8954635-c5c7-4afd-895f-c8b4d9217b3c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] HCTL ('41', '-', '-', 0) found on session 20 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c749b657-d0cd-4f99-8f51-38721fec8f12]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Searching for a device in session 20 and hctl ['41', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Searching for a device in session 20 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjeoGugH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23839356263323163', 'path': '/dev/sdj'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839356263323163', 'path': '/dev/sdj'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4e:8d,bridge_name='br-int',has_traffic_filtering=True,id=3a779839-57b1-4b62-82c4-7a7cc7eb2abe,network=Network(5d67b529-e9c2-4269-b640-70e899501ed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a779839-57') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=54546932-5914-428a-bbdc-887e3b128f96,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54546932-59') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:0e,bridge_name='br-int',has_traffic_filtering=True,id=99865ff8-659c-4199-b3c9-371b5481c5ac,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99865ff8-65') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7a27d08a-1050-40f1-9af8-f05e3b4a39c4,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a27d08a-10') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:40,bridge_name='br-int',has_traffic_filtering=True,id=fa4338d3-8249-4aab-8e23-8d254737e00b,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4338d3-82') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5a:55,bridge_name='br-int',has_traffic_filtering=True,id=03a6d148-7ee7-4fff-a49e-4fa1d6736ec4,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a6d148-7e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:52,bridge_name='br-int',has_traffic_filtering=True,id=e13357c8-b09a-41d6-9ccb-36a02e3ce2e1,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13357c8-b0') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.objects.instance [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lazy-loading 'pci_devices' on Instance uuid e5501afd-b133-451c-b16e-3f03b22cdf66 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:33:27 user nova-compute[75000]:   <uuid>e5501afd-b133-451c-b16e-3f03b22cdf66</uuid>
Nov 06 22:33:27 user nova-compute[75000]:   <name>instance-00000013</name>
Nov 06 22:33:27 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:33:27 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:33:27 user nova-compute[75000]:   <metadata>
Nov 06 22:33:27 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:33:27 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:33:27 user nova-compute[75000]:       <nova:name>tempest-device-tagging-server-1106496954</nova:name>
Nov 06 22:33:27 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:33:23</nova:creationTime>
Nov 06 22:33:27 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:33:27 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:33:27 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:33:27 user nova-compute[75000]:       <nova:owner>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:user uuid="bbceb6180510486c8f3bd60985e0b5a7">tempest-TaggedBootDevicesTest-2012630351-project-member</nova:user>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:project uuid="df531ecc8a244028bad3f3cbd63eaf57">tempest-TaggedBootDevicesTest-2012630351</nova:project>
Nov 06 22:33:27 user nova-compute[75000]:       </nova:owner>
Nov 06 22:33:27 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:33:27 user nova-compute[75000]:       <nova:ports>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:port uuid="3a779839-57b1-4b62-82c4-7a7cc7eb2abe">
Nov 06 22:33:27 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 22:33:27 user nova-compute[75000]:         </nova:port>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:port uuid="54546932-5914-428a-bbdc-887e3b128f96">
Nov 06 22:33:27 user nova-compute[75000]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Nov 06 22:33:27 user nova-compute[75000]:         </nova:port>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:port uuid="99865ff8-659c-4199-b3c9-371b5481c5ac">
Nov 06 22:33:27 user nova-compute[75000]:           <nova:ip type="fixed" address="10.1.1.34" ipVersion="4"/>
Nov 06 22:33:27 user nova-compute[75000]:         </nova:port>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:port uuid="7a27d08a-1050-40f1-9af8-f05e3b4a39c4">
Nov 06 22:33:27 user nova-compute[75000]:           <nova:ip type="fixed" address="10.1.1.160" ipVersion="4"/>
Nov 06 22:33:27 user nova-compute[75000]:         </nova:port>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:port uuid="fa4338d3-8249-4aab-8e23-8d254737e00b">
Nov 06 22:33:27 user nova-compute[75000]:           <nova:ip type="fixed" address="10.1.1.164" ipVersion="4"/>
Nov 06 22:33:27 user nova-compute[75000]:         </nova:port>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:port uuid="03a6d148-7ee7-4fff-a49e-4fa1d6736ec4">
Nov 06 22:33:27 user nova-compute[75000]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 06 22:33:27 user nova-compute[75000]:         </nova:port>
Nov 06 22:33:27 user nova-compute[75000]:         <nova:port uuid="e13357c8-b09a-41d6-9ccb-36a02e3ce2e1">
Nov 06 22:33:27 user nova-compute[75000]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 06 22:33:27 user nova-compute[75000]:         </nova:port>
Nov 06 22:33:27 user nova-compute[75000]:       </nova:ports>
Nov 06 22:33:27 user nova-compute[75000]:     </nova:instance>
Nov 06 22:33:27 user nova-compute[75000]:   </metadata>
Nov 06 22:33:27 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:33:27 user nova-compute[75000]:     <system>
Nov 06 22:33:27 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:33:27 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:33:27 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:33:27 user nova-compute[75000]:       <entry name="serial">e5501afd-b133-451c-b16e-3f03b22cdf66</entry>
Nov 06 22:33:27 user nova-compute[75000]:       <entry name="uuid">e5501afd-b133-451c-b16e-3f03b22cdf66</entry>
Nov 06 22:33:27 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:33:27 user nova-compute[75000]:     </system>
Nov 06 22:33:27 user nova-compute[75000]:   </sysinfo>
Nov 06 22:33:27 user nova-compute[75000]:   <os>
Nov 06 22:33:27 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:33:27 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:33:27 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:33:27 user nova-compute[75000]:   </os>
Nov 06 22:33:27 user nova-compute[75000]:   <features>
Nov 06 22:33:27 user nova-compute[75000]:     <acpi/>
Nov 06 22:33:27 user nova-compute[75000]:     <apic/>
Nov 06 22:33:27 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:33:27 user nova-compute[75000]:   </features>
Nov 06 22:33:27 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:33:27 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:33:27 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:33:27 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:33:27 user nova-compute[75000]:   </clock>
Nov 06 22:33:27 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:33:27 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:33:27 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:33:27 user nova-compute[75000]:   </cpu>
Nov 06 22:33:27 user nova-compute[75000]:   <devices>
Nov 06 22:33:27 user nova-compute[75000]:     <disk type="file" device="cdrom">
Nov 06 22:33:27 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 22:33:27 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/e5501afd-b133-451c-b16e-3f03b22cdf66/disk.config"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="hda" bus="ide"/>
Nov 06 22:33:27 user nova-compute[75000]:     </disk>
Nov 06 22:33:27 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:33:27 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:33:27 user nova-compute[75000]:       <source dev="/dev/sdh"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <serial>51516dc7-babc-4eda-866e-0245b93bdec0</serial>
Nov 06 22:33:27 user nova-compute[75000]:     </disk>
Nov 06 22:33:27 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:33:27 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:33:27 user nova-compute[75000]:       <source dev="/dev/sdi"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <serial>0dbd0369-23b5-4036-be4a-fcf6ba4c9b76</serial>
Nov 06 22:33:27 user nova-compute[75000]:     </disk>
Nov 06 22:33:27 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:33:27 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:33:27 user nova-compute[75000]:       <source dev="/dev/sdj"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="vdc" bus="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <serial>ff7647fd-5314-4376-b166-994b9ca3e320</serial>
Nov 06 22:33:27 user nova-compute[75000]:     </disk>
Nov 06 22:33:27 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:33:27 user nova-compute[75000]:       <mac address="fa:16:3e:86:4e:8d"/>
Nov 06 22:33:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="tap3a779839-57"/>
Nov 06 22:33:27 user nova-compute[75000]:     </interface>
Nov 06 22:33:27 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:33:27 user nova-compute[75000]:       <mac address="fa:16:3e:09:3f:3b"/>
Nov 06 22:33:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="tap54546932-59"/>
Nov 06 22:33:27 user nova-compute[75000]:     </interface>
Nov 06 22:33:27 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:33:27 user nova-compute[75000]:       <mac address="fa:16:3e:25:6c:0e"/>
Nov 06 22:33:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="tap99865ff8-65"/>
Nov 06 22:33:27 user nova-compute[75000]:     </interface>
Nov 06 22:33:27 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:33:27 user nova-compute[75000]:       <mac address="fa:16:3e:7e:47:f7"/>
Nov 06 22:33:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="tap7a27d08a-10"/>
Nov 06 22:33:27 user nova-compute[75000]:     </interface>
Nov 06 22:33:27 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:33:27 user nova-compute[75000]:       <mac address="fa:16:3e:b2:e4:40"/>
Nov 06 22:33:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="tapfa4338d3-82"/>
Nov 06 22:33:27 user nova-compute[75000]:     </interface>
Nov 06 22:33:27 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:33:27 user nova-compute[75000]:       <mac address="fa:16:3e:6f:5a:55"/>
Nov 06 22:33:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="tap03a6d148-7e"/>
Nov 06 22:33:27 user nova-compute[75000]:     </interface>
Nov 06 22:33:27 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:33:27 user nova-compute[75000]:       <mac address="fa:16:3e:cc:f7:52"/>
Nov 06 22:33:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:33:27 user nova-compute[75000]:       <target dev="tape13357c8-b0"/>
Nov 06 22:33:27 user nova-compute[75000]:     </interface>
Nov 06 22:33:27 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:33:27 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/e5501afd-b133-451c-b16e-3f03b22cdf66/console.log" append="off"/>
Nov 06 22:33:27 user nova-compute[75000]:     </serial>
Nov 06 22:33:27 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:33:27 user nova-compute[75000]:     <video>
Nov 06 22:33:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:27 user nova-compute[75000]:     </video>
Nov 06 22:33:27 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:33:27 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:33:27 user nova-compute[75000]:     </rng>
Nov 06 22:33:27 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:33:27 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:33:27 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:33:27 user nova-compute[75000]:     </memballoon>
Nov 06 22:33:27 user nova-compute[75000]:   </devices>
Nov 06 22:33:27 user nova-compute[75000]: </domain>
Nov 06 22:33:27 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4e:8d,bridge_name='br-int',has_traffic_filtering=True,id=3a779839-57b1-4b62-82c4-7a7cc7eb2abe,network=Network(5d67b529-e9c2-4269-b640-70e899501ed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a779839-57') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4e:8d,bridge_name='br-int',has_traffic_filtering=True,id=3a779839-57b1-4b62-82c4-7a7cc7eb2abe,network=Network(5d67b529-e9c2-4269-b640-70e899501ed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a779839-57') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4070771b-87c8-5c37-85e9-f876427ab0b7', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a779839-57, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a779839-57, col_values=(('qos', UUID('43a00341-b7b9-4cb3-b596-5ea98687d0de')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a779839-57, col_values=(('external_ids', {'iface-id': '3a779839-57b1-4b62-82c4-7a7cc7eb2abe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:4e:8d', 'vm-uuid': 'e5501afd-b133-451c-b16e-3f03b22cdf66'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: INFO os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4e:8d,bridge_name='br-int',has_traffic_filtering=True,id=3a779839-57b1-4b62-82c4-7a7cc7eb2abe,network=Network(5d67b529-e9c2-4269-b640-70e899501ed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a779839-57')
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=54546932-5914-428a-bbdc-887e3b128f96,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54546932-59') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=54546932-5914-428a-bbdc-887e3b128f96,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54546932-59') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1111d30c-f551-5500-99ec-9cfd5e6c91d9', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54546932-59, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54546932-59, col_values=(('qos', UUID('02ae34bb-1b7f-4681-871b-327b3c2c7a73')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54546932-59, col_values=(('external_ids', {'iface-id': '54546932-5914-428a-bbdc-887e3b128f96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:3f:3b', 'vm-uuid': 'e5501afd-b133-451c-b16e-3f03b22cdf66'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: INFO os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=54546932-5914-428a-bbdc-887e3b128f96,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54546932-59')
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:0e,bridge_name='br-int',has_traffic_filtering=True,id=99865ff8-659c-4199-b3c9-371b5481c5ac,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99865ff8-65') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:0e,bridge_name='br-int',has_traffic_filtering=True,id=99865ff8-659c-4199-b3c9-371b5481c5ac,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99865ff8-65') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '935a89c2-0538-5048-b8e4-435298a65a47', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99865ff8-65, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99865ff8-65, col_values=(('qos', UUID('3231e170-acbb-4e43-bc89-61e5b40beb75')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99865ff8-65, col_values=(('external_ids', {'iface-id': '99865ff8-659c-4199-b3c9-371b5481c5ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:6c:0e', 'vm-uuid': 'e5501afd-b133-451c-b16e-3f03b22cdf66'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: INFO os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:0e,bridge_name='br-int',has_traffic_filtering=True,id=99865ff8-659c-4199-b3c9-371b5481c5ac,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99865ff8-65')
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7a27d08a-1050-40f1-9af8-f05e3b4a39c4,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a27d08a-10') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7a27d08a-1050-40f1-9af8-f05e3b4a39c4,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a27d08a-10') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35c0b1cd-c862-5bbb-b957-eb0a7f93f95f', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a27d08a-10, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a27d08a-10, col_values=(('qos', UUID('d6235d4e-1b5e-4a0c-bac1-ced5f5d79eed')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a27d08a-10, col_values=(('external_ids', {'iface-id': '7a27d08a-1050-40f1-9af8-f05e3b4a39c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:47:f7', 'vm-uuid': 'e5501afd-b133-451c-b16e-3f03b22cdf66'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:27 user nova-compute[75000]: INFO os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7a27d08a-1050-40f1-9af8-f05e3b4a39c4,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a27d08a-10')
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:33:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:40,bridge_name='br-int',has_traffic_filtering=True,id=fa4338d3-8249-4aab-8e23-8d254737e00b,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4338d3-82') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:40,bridge_name='br-int',has_traffic_filtering=True,id=fa4338d3-8249-4aab-8e23-8d254737e00b,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4338d3-82') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55b9bdb5-9232-5cab-93b2-36a9f4f6cb57', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa4338d3-82, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa4338d3-82, col_values=(('qos', UUID('076f54fe-48ac-4e59-a333-3b3ef832153f')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa4338d3-82, col_values=(('external_ids', {'iface-id': 'fa4338d3-8249-4aab-8e23-8d254737e00b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:e4:40', 'vm-uuid': 'e5501afd-b133-451c-b16e-3f03b22cdf66'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: INFO os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:40,bridge_name='br-int',has_traffic_filtering=True,id=fa4338d3-8249-4aab-8e23-8d254737e00b,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4338d3-82')
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5a:55,bridge_name='br-int',has_traffic_filtering=True,id=03a6d148-7ee7-4fff-a49e-4fa1d6736ec4,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a6d148-7e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5a:55,bridge_name='br-int',has_traffic_filtering=True,id=03a6d148-7ee7-4fff-a49e-4fa1d6736ec4,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a6d148-7e') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eab3d4b2-07c7-5059-8623-fa432081f315', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03a6d148-7e, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03a6d148-7e, col_values=(('qos', UUID('c0e6ec55-d220-4f9e-883c-a3948b197601')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03a6d148-7e, col_values=(('external_ids', {'iface-id': '03a6d148-7ee7-4fff-a49e-4fa1d6736ec4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:5a:55', 'vm-uuid': 'e5501afd-b133-451c-b16e-3f03b22cdf66'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: INFO os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5a:55,bridge_name='br-int',has_traffic_filtering=True,id=03a6d148-7ee7-4fff-a49e-4fa1d6736ec4,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a6d148-7e')
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:52,bridge_name='br-int',has_traffic_filtering=True,id=e13357c8-b09a-41d6-9ccb-36a02e3ce2e1,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13357c8-b0') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:52,bridge_name='br-int',has_traffic_filtering=True,id=e13357c8-b09a-41d6-9ccb-36a02e3ce2e1,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13357c8-b0') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cd5e5d7-0621-5acd-a856-f196ef6e3756', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape13357c8-b0, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape13357c8-b0, col_values=(('qos', UUID('c97caa10-af40-4404-9d5a-d746dc031562')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape13357c8-b0, col_values=(('external_ids', {'iface-id': 'e13357c8-b09a-41d6-9ccb-36a02e3ce2e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f7:52', 'vm-uuid': 'e5501afd-b133-451c-b16e-3f03b22cdf66'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:28 user nova-compute[75000]: INFO os_vif [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:52,bridge_name='br-int',has_traffic_filtering=True,id=e13357c8-b09a-41d6-9ccb-36a02e3ce2e1,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13357c8-b0')
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] No BDM found with device name hda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] No VIF found with MAC fa:16:3e:86:4e:8d, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] No VIF found with MAC fa:16:3e:b2:e4:40, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:33:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Using config drive
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Creating config drive at /opt/stack/data/nova/instances/e5501afd-b133-451c-b16e-3f03b22cdf66/disk.config
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e5501afd-b133-451c-b16e-3f03b22cdf66/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxfzyn2wx {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e5501afd-b133-451c-b16e-3f03b22cdf66/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxfzyn2wx" returned: 0 in 0.056s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJWiBPSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:33:30 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:30 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:30 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a56062-41ad-429d-9957-6ff82b76f5de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:33:30 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aaba34-7ad1-405e-a314-60286d0fe789]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69] added
Nov 06 22:33:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691cb3b-7f8e-425f-9863-a6ba86b47cc0]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e5f49e-4bab-4172-b031-9f47e97c6116]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJWiBPSc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJWiBPSc" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b913c98-da8a-4240-bfa5-8530ca687078]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fJWiBPSc'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00827395-446a-4fb4-9f4f-4d155f49898a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d18956-3b7a-4f7a-963c-53e7d496d14f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee8000-b6d4-42d8-99ef-698986d81614]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69, portal: 172.16.0.220,3260]
Nov 06 22:33:30 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69, portal: 172.16.0.220,3260] successful.
Nov 06 22:33:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6f7ab0-0a81-4c24-9f0b-74e6a0e92d61]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.063s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de83ab16-691c-4c10-9f19-e86b6f42a63e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.471s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] HCTL ('42', '-', '-', 0) found on session 21 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c4aa52-40ed-430d-8523-508a0b08c406]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Searching for a device in session 21 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJWiBPSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-06124737-d19e-4f98-babe-bb5b158955d7 req-e4f2138a-3f4b-4450-954b-45053f00ba78 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-06124737-d19e-4f98-babe-bb5b158955d7 req-e4f2138a-3f4b-4450-954b-45053f00ba78 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-06124737-d19e-4f98-babe-bb5b158955d7 req-e4f2138a-3f4b-4450-954b-45053f00ba78 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-06124737-d19e-4f98-babe-bb5b158955d7 req-e4f2138a-3f4b-4450-954b-45053f00ba78 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-06124737-d19e-4f98-babe-bb5b158955d7 req-e4f2138a-3f4b-4450-954b-45053f00ba78 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:30 user nova-compute[75000]: WARNING nova.compute.manager [req-06124737-d19e-4f98-babe-bb5b158955d7 req-e4f2138a-3f4b-4450-954b-45053f00ba78 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe for instance with vm_state building and task_state spawning.
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-299ef33a-c22a-42a6-93dc-5ef82d09ebb7 req-0d74f7ec-248e-464a-94ae-a0a4b22d1fc3 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-299ef33a-c22a-42a6-93dc-5ef82d09ebb7 req-0d74f7ec-248e-464a-94ae-a0a4b22d1fc3 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-299ef33a-c22a-42a6-93dc-5ef82d09ebb7 req-0d74f7ec-248e-464a-94ae-a0a4b22d1fc3 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-299ef33a-c22a-42a6-93dc-5ef82d09ebb7 req-0d74f7ec-248e-464a-94ae-a0a4b22d1fc3 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-299ef33a-c22a-42a6-93dc-5ef82d09ebb7 req-0d74f7ec-248e-464a-94ae-a0a4b22d1fc3 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:31 user nova-compute[75000]: WARNING nova.compute.manager [req-299ef33a-c22a-42a6-93dc-5ef82d09ebb7 req-0d74f7ec-248e-464a-94ae-a0a4b22d1fc3 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-99865ff8-659c-4199-b3c9-371b5481c5ac for instance with vm_state building and task_state spawning.
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.558s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] <== connect_volume: return (1562ms) {'type': 'block', 'scsi_wwn': '23032616239613530', 'path': '/dev/sdk'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032616239613530', 'path': '/dev/sdk'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.objects.instance [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lazy-loading 'flavor' on Instance uuid 0414d03a-aba0-44df-9cca-257ab81bde61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:33:31 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:33:31 user nova-compute[75000]:   <source dev="/dev/sdk"/>
Nov 06 22:33:31 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:33:31 user nova-compute[75000]:   <serial>7e0cfc65-a19c-4443-8f7d-21d28214de69</serial>
Nov 06 22:33:31 user nova-compute[75000]: </disk>
Nov 06 22:33:31 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-6e1ae38e-a951-4aed-b4ff-bc20f49f96b0 req-c7eb45f2-45a8-4883-9b6a-8bd842655aed service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-changed-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-6e1ae38e-a951-4aed-b4ff-bc20f49f96b0 req-c7eb45f2-45a8-4883-9b6a-8bd842655aed service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing instance network info cache due to event network-changed-edd9c5b2-a58a-40e1-a90b-3369f3956182. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6e1ae38e-a951-4aed-b4ff-bc20f49f96b0 req-c7eb45f2-45a8-4883-9b6a-8bd842655aed service nova] Acquiring lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6e1ae38e-a951-4aed-b4ff-bc20f49f96b0 req-c7eb45f2-45a8-4883-9b6a-8bd842655aed service nova] Acquired lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG nova.network.neutron [req-6e1ae38e-a951-4aed-b4ff-bc20f49f96b0 req-c7eb45f2-45a8-4883-9b6a-8bd842655aed service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Refreshing network info cache for port edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] No VIF found with MAC fa:16:3e:5d:6a:0d, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-014a7999-5e50-43d3-99b9-996f469db0b7 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.585s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:32 user nova-compute[75000]: WARNING nova.compute.manager [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe for instance with vm_state building and task_state spawning.
Nov 06 22:33:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:32 user nova-compute[75000]: WARNING nova.compute.manager [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-54546932-5914-428a-bbdc-887e3b128f96 for instance with vm_state building and task_state spawning.
Nov 06 22:33:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:32 user nova-compute[75000]: WARNING nova.compute.manager [req-6a4dd8cf-68cd-425a-bea5-6ad8a47871f0 req-ce388ec7-75f0-4cff-9029-ee65b2996c93 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-54546932-5914-428a-bbdc-887e3b128f96 for instance with vm_state building and task_state spawning.
Nov 06 22:33:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.network.neutron [req-6e1ae38e-a951-4aed-b4ff-bc20f49f96b0 req-c7eb45f2-45a8-4883-9b6a-8bd842655aed service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updated VIF entry in instance network info cache for port edd9c5b2-a58a-40e1-a90b-3369f3956182. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.network.neutron [req-6e1ae38e-a951-4aed-b4ff-bc20f49f96b0 req-c7eb45f2-45a8-4883-9b6a-8bd842655aed service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [{"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-99865ff8-659c-4199-b3c9-371b5481c5ac for instance with vm_state building and task_state spawning.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 for instance with vm_state building and task_state spawning.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 for instance with vm_state building and task_state spawning.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-fa4338d3-8249-4aab-8e23-8d254737e00b for instance with vm_state building and task_state spawning.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.compute.manager [req-984c008b-5fc1-4b87-bc03-b325d22179df req-923a2173-cb10-49c7-a277-4079ba761fc1 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-fa4338d3-8249-4aab-8e23-8d254737e00b for instance with vm_state building and task_state spawning.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 for instance with vm_state building and task_state spawning.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 for instance with vm_state building and task_state spawning.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 for instance with vm_state building and task_state spawning.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.compute.manager [req-00c3ae96-143b-4471-b4fd-095f2bb1fa2d req-cfa007a8-4bc5-4243-93f8-98b2bb635b56 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 for instance with vm_state building and task_state spawning.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6e1ae38e-a951-4aed-b4ff-bc20f49f96b0 req-c7eb45f2-45a8-4883-9b6a-8bd842655aed service nova] Releasing lock "refresh_cache-c9422249-ff7a-455e-87e1-bdce3e0345f1" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:33:35 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7180MB free_disk=25.16434097290039GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance spawned successfully.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:35 user nova-compute[75000]: INFO nova.compute.manager [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Terminating instance
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:35 user nova-compute[75000]: INFO nova.compute.manager [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Detaching volume 7e0cfc65-a19c-4443-8f7d-21d28214de69
Nov 06 22:33:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:35 user nova-compute[75000]: INFO nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Took 12.60 seconds to spawn the instance on the hypervisor.
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:33:35 user nova-compute[75000]: INFO nova.virt.block_device [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Attempting to driver detach volume 7e0cfc65-a19c-4443-8f7d-21d28214de69 from mountpoint /dev/vdb
Nov 06 22:33:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c9422249-ff7a-455e-87e1-bdce3e0345f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 846bf5e2-230c-419c-be77-982acc036b40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0414d03a-aba0-44df-9cca-257ab81bde61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance e5501afd-b133-451c-b16e-3f03b22cdf66 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 98957082-bdb6-472c-9462-f3e8d7340a20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:33:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Attempting to detach device vdb from instance 0414d03a-aba0-44df-9cca-257ab81bde61 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:33:36 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:33:36 user nova-compute[75000]:   <source dev="/dev/sdk"/>
Nov 06 22:33:36 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:33:36 user nova-compute[75000]:   <serial>7e0cfc65-a19c-4443-8f7d-21d28214de69</serial>
Nov 06 22:33:36 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:33:36 user nova-compute[75000]: </disk>
Nov 06 22:33:36 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:33:36 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Successfully detached device vdb from instance 0414d03a-aba0-44df-9cca-257ab81bde61 from the persistent domain config.
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0414d03a-aba0-44df-9cca-257ab81bde61 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:33:36 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:33:36 user nova-compute[75000]:   <source dev="/dev/sdk"/>
Nov 06 22:33:36 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:33:36 user nova-compute[75000]:   <serial>7e0cfc65-a19c-4443-8f7d-21d28214de69</serial>
Nov 06 22:33:36 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:33:36 user nova-compute[75000]: </disk>
Nov 06 22:33:36 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: INFO nova.compute.manager [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Took 96.41 seconds to build instance.
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-463e73c8-6f48-4575-8766-2fd262940f8a req-e4b79a9e-0452-4b4a-939b-2715560acdd4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-463e73c8-6f48-4575-8766-2fd262940f8a req-e4b79a9e-0452-4b4a-939b-2715560acdd4 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-463e73c8-6f48-4575-8766-2fd262940f8a req-e4b79a9e-0452-4b4a-939b-2715560acdd4 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-463e73c8-6f48-4575-8766-2fd262940f8a req-e4b79a9e-0452-4b4a-939b-2715560acdd4 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-463e73c8-6f48-4575-8766-2fd262940f8a req-e4b79a9e-0452-4b4a-939b-2715560acdd4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-unplugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-463e73c8-6f48-4575-8766-2fd262940f8a req-e4b79a9e-0452-4b4a-939b-2715560acdd4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ec683e3c-cd27-46ae-b004-bbf0b12e47cb tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 96.561s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0414d03a-aba0-44df-9cca-257ab81bde61 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.878s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-unplugged-e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-e1a63239-aa0a-4355-9199-1b1def6d7343 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-e1a63239-aa0a-4355-9199-1b1def6d7343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:37 user nova-compute[75000]: WARNING nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-e1a63239-aa0a-4355-9199-1b1def6d7343 for instance with vm_state active and task_state deleting.
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-unplugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:37 user nova-compute[75000]: WARNING nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-f5aefaa0-9af2-47b8-bcd2-3c572594b338 for instance with vm_state active and task_state deleting.
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-unplugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-b48a4d5c-53d0-4a74-b0d6-aa0208cf0e0c req-182672a6-7820-404a-81d4-e9d2d512beee service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:33:37 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Instance destroyed successfully.
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.objects.instance [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lazy-loading 'resources' on Instance uuid c9422249-ff7a-455e-87e1-bdce3e0345f1 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5f:ee,bridge_name='br-int',has_traffic_filtering=True,id=edd9c5b2-a58a-40e1-a90b-3369f3956182,network=Network(735f189b-f05d-4097-b884-9623beab8c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd9c5b2-a5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5f:ee,bridge_name='br-int',has_traffic_filtering=True,id=edd9c5b2-a58a-40e1-a90b-3369f3956182,network=Network(735f189b-f05d-4097-b884-9623beab8c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd9c5b2-a5') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedd9c5b2-a5, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64d026e6-0243-4c68-a022-f44d656ba064) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: INFO os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5f:ee,bridge_name='br-int',has_traffic_filtering=True,id=edd9c5b2-a58a-40e1-a90b-3369f3956182,network=Network(735f189b-f05d-4097-b884-9623beab8c1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd9c5b2-a5')
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=e1a63239-aa0a-4355-9199-1b1def6d7343,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a63239-aa') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=e1a63239-aa0a-4355-9199-1b1def6d7343,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a63239-aa') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1a63239-aa, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=005b77fb-30be-4fde-85ef-a6a1f48a73f1) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: INFO os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=e1a63239-aa0a-4355-9199-1b1def6d7343,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a63239-aa')
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b4:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5aefaa0-9af2-47b8-bcd2-3c572594b338,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5aefaa0-9a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b4:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5aefaa0-9af2-47b8-bcd2-3c572594b338,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5aefaa0-9a') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5aefaa0-9a, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ea2ec40-5536-4bd0-9b4b-12748c5206e8) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: INFO os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b4:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5aefaa0-9af2-47b8-bcd2-3c572594b338,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf5aefaa0-9a')
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "address": "fa:16:3e:a2:6b:2a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38f353-bd", "ovs_interfaceid": "8a38f353-bd3b-4a59-a4d3-04728260fdf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8a38f353-bd3b-4a59-a4d3-04728260fdf4,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38f353-bd') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8a38f353-bd3b-4a59-a4d3-04728260fdf4,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38f353-bd') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a38f353-bd, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cffc6d3-43fa-41bb-9551-b1bd724d6ea4) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: INFO os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:6b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8a38f353-bd3b-4a59-a4d3-04728260fdf4,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38f353-bd')
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=13a5c008-7743-43d9-89d9-79cb2eb79450,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a5c008-77') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=13a5c008-7743-43d9-89d9-79cb2eb79450,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a5c008-77') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13a5c008-77, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9434f0ae-0342-4c1a-ac38-18dd394c9533) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: INFO os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:b9:0a,bridge_name='br-int',has_traffic_filtering=True,id=13a5c008-7743-43d9-89d9-79cb2eb79450,network=Network(26ae18e6-4448-405e-9a79-2fec9c183069),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13a5c008-77')
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:53:4a,bridge_name='br-int',has_traffic_filtering=True,id=5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b17d3f3-90') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:53:4a,bridge_name='br-int',has_traffic_filtering=True,id=5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b17d3f3-90') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b17d3f3-90, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c1b28c1-047b-4828-a677-26903921159f) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: INFO os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:53:4a,bridge_name='br-int',has_traffic_filtering=True,id=5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b17d3f3-90')
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732079075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732079075',id=15,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsfhF//wc5+4V6HJ0pVGiUyMVUeicfgj8w99rZIcGCVQlA99foAcoSjc2/traMTVcut9Vuwr0jcw6Q6lo1BCkkXgi5MrOsgMNJumw5VaTPgqnmTCeHNMyJFJhT7BsVC1g==',key_name='tempest-keypair-1735160913',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af4172b6528d4cb282b1906ef73fadf2',ramdisk_id='',reservation_id='r-xvf21xei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-263042162',owner_user_name='tempest-TaggedBootDevicesTest_v242-263042162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81298fc90bc8498db1b9a2ecc8d272c8',uuid=c9422249-ff7a-455e-87e1-bdce3e0345f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converting VIF {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:f2:81,bridge_name='br-int',has_traffic_filtering=True,id=ba040a18-e2d6-4599-a641-f459aed99c3c,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba040a18-e2') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f2:81,bridge_name='br-int',has_traffic_filtering=True,id=ba040a18-e2d6-4599-a641-f459aed99c3c,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba040a18-e2') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:38 user nova-compute[75000]: WARNING nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-edd9c5b2-a58a-40e1-a90b-3369f3956182 for instance with vm_state active and task_state deleting.
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-unplugged-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-13a5c008-7743-43d9-89d9-79cb2eb79450 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:38 user nova-compute[75000]: WARNING nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-13a5c008-7743-43d9-89d9-79cb2eb79450 for instance with vm_state active and task_state deleting.
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-unplugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:38 user nova-compute[75000]: WARNING nova.compute.manager [req-808aaf70-87b0-4178-9784-ccb9087e0313 req-ea7b77d8-afbf-4d02-b4bf-93fd48a7cbdf service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 for instance with vm_state active and task_state deleting.
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba040a18-e2, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adc9a01f-9a1b-49e2-a885-2119a763353d) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:38 user nova-compute[75000]: INFO os_vif [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:f2:81,bridge_name='br-int',has_traffic_filtering=True,id=ba040a18-e2d6-4599-a641-f459aed99c3c,network=Network(d4f05b48-ab49-4596-8c0a-1db8da677cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba040a18-e2')
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cHrMZLvx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:33:38 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf57266-f5ff-4da8-92c7-ba9fe733088d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:33:38 user nova-compute[75000]: No targets found.
Nov 06 22:33:38 user nova-compute[75000]: iSNS:
Nov 06 22:33:38 user nova-compute[75000]: No targets found.
Nov 06 22:33:38 user nova-compute[75000]: STATIC:
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: FIRMWARE:
Nov 06 22:33:38 user nova-compute[75000]: No targets found.
Nov 06 22:33:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:33:38 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:33:38 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dbd568-6e03-4fb5-a0e2-c7c5c44ee355]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[78af1cae-19fb-41ef-9ac3-0712a3c8d42f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc295f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569'): ({'sde'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Removing single pathed devices sde {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3201fc3a-fe26-4119-9cf6-4b2f05be1d34]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3483f98-7104-458f-b61c-a708abe3a0fe]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Flushing IO for device /dev/sde {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[522d606e-6b0a-4a93-8723-e8f411ba110f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09c8287-4ebd-4a60-86aa-62612b158aba]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454e751-3b25-4563-85a1-a28fef8008ba]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd98a42-8da3-44a8-a5b3-a5930be217d7]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569, portal: 172.16.0.220,3260]
Nov 06 22:33:38 user nova-compute[75000]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569, portal: 172.16.0.220,3260] successful.
Nov 06 22:33:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e1fcc01-a3aa-4896-ba3f-f7509a966569 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0195bd09-fd03-47ba-8235-ea0d8cdad1be]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] <== disconnect_volume: return (373ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdOJoHNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:33:38 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[252362e3-adc2-4a43-89dd-3099cc44e686]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:33:38 user nova-compute[75000]: No targets found.
Nov 06 22:33:38 user nova-compute[75000]: iSNS:
Nov 06 22:33:38 user nova-compute[75000]: No targets found.
Nov 06 22:33:38 user nova-compute[75000]: STATIC:
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0
Nov 06 22:33:38 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:38 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:38 user nova-compute[75000]: FIRMWARE:
Nov 06 22:33:38 user nova-compute[75000]: No targets found.
Nov 06 22:33:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:33:38 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:33:38 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Skipping network cache update for instance because it is being deleted. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3faf0e-5f63-46a6-aebb-2766e784e716]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829e98b-3667-45d3-a475-0da9bd28502f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79fc4036d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818'): ({'sdf'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Removing single pathed devices sdf {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid bf3bafdf-dba5-4961-a891-98f522b27f53 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4dc487-b49b-4acb-a81b-bda7b67a00f5]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6306147c-9d12-4085-96dd-44109c018eed]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Flushing IO for device /dev/sdf {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[957c68b4-e8d3-40e5-a3ca-2ec69a1d7357]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[847bf21c-2d15-4908-8ad7-a63d771e096f]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] SCSI volumes sdf have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f77e9f8-ea6e-4126-a752-52c3ed0e3880]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bb8ba9-7f9f-47b2-9276-22cc684a96dc]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818, portal: 172.16.0.220,3260]
Nov 06 22:33:39 user nova-compute[75000]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818, portal: 172.16.0.220,3260] successful.
Nov 06 22:33:39 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0883f49d-f390-4aba-8a64-388111d2b818 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b1288b-e7f2-4906-831c-4f40c5462464]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] <== disconnect_volume: return (471ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJExraP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:33:39 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf51bacd-a0c8-4170-b266-9a58320eb059]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:33:39 user nova-compute[75000]: No targets found.
Nov 06 22:33:39 user nova-compute[75000]: iSNS:
Nov 06 22:33:39 user nova-compute[75000]: No targets found.
Nov 06 22:33:39 user nova-compute[75000]: STATIC:
Nov 06 22:33:39 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76
Nov 06 22:33:39 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:39 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:39 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:33:39 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:39 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:39 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69
Nov 06 22:33:39 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:39 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:39 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:33:39 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:39 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:39 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:33:39 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:39 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:39 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809
Nov 06 22:33:39 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:39 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:39 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320
Nov 06 22:33:39 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:39 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:39 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0
Nov 06 22:33:39 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:39 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:39 user nova-compute[75000]: FIRMWARE:
Nov 06 22:33:39 user nova-compute[75000]: No targets found.
Nov 06 22:33:39 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:33:39 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:33:39 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9010a422-3a65-4a70-8373-d4b180681954]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7977673-90bc-4d5f-a191-29858f4608b5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:39 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc703a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf50766-4158-42b8-84a5-eb8bd9ef37ce]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ede20d-74e6-4d59-8a8e-258d18500168]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e516b-7d33-40ad-860c-60c3d016ba86]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updating instance_info_cache with network_info: [{"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99871f63-8152-46ec-bd90-28517b84c86c]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd0adc3-a9e8-4257-a2be-f7313b911b6a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[011dadf0-eb4b-478d-bdc0-106caec01f68]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809, portal: 172.16.0.220,3260]
Nov 06 22:33:39 user nova-compute[75000]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809, portal: 172.16.0.220,3260] successful.
Nov 06 22:33:39 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:39 user nova-compute[75000]: WARNING nova.compute.manager [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-8a38f353-bd3b-4a59-a4d3-04728260fdf4 for instance with vm_state active and task_state deleting.
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-unplugged-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-unplugged-ba040a18-e2d6-4599-a641-f459aed99c3c for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-plugged-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] Acquiring lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] No waiting events found dispatching network-vif-plugged-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:39 user nova-compute[75000]: WARNING nova.compute.manager [req-b90522aa-dc0b-42a4-a9a6-f1050918b729 req-cb4050b7-f2ce-47da-872d-a75b53639684 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received unexpected event network-vif-plugged-ba040a18-e2d6-4599-a641-f459aed99c3c for instance with vm_state active and task_state deleting.
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4359b8e6-705d-4b18-a7b2-96b65ca06809 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa82914-4e86-4fbf-bdc3-7d9eb2a13575]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] <== disconnect_volume: return (401ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:33:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Deleting instance files /opt/stack/data/nova/instances/c9422249-ff7a-455e-87e1-bdce3e0345f1_del
Nov 06 22:33:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Deletion of /opt/stack/data/nova/instances/c9422249-ff7a-455e-87e1-bdce3e0345f1_del complete
Nov 06 22:33:39 user nova-compute[75000]: INFO nova.compute.manager [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Took 3.78 seconds to destroy the instance on the hypervisor.
Nov 06 22:33:39 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:33:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-844433bf-8366-4019-a072-6d51997fd5ee req-deb35349-944e-4ca8-98f9-c961797a6be4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-deleted-8a38f353-bd3b-4a59-a4d3-04728260fdf4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:42 user nova-compute[75000]: INFO nova.compute.manager [req-844433bf-8366-4019-a072-6d51997fd5ee req-deb35349-944e-4ca8-98f9-c961797a6be4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Neutron deleted interface 8a38f353-bd3b-4a59-a4d3-04728260fdf4; detaching it from the instance and deleting it from the info cache
Nov 06 22:33:42 user nova-compute[75000]: DEBUG nova.network.neutron [req-844433bf-8366-4019-a072-6d51997fd5ee req-deb35349-944e-4ca8-98f9-c961797a6be4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [{"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13a5c008-7743-43d9-89d9-79cb2eb79450", "address": "fa:16:3e:0b:b9:0a", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13a5c008-77", "ovs_interfaceid": "13a5c008-7743-43d9-89d9-79cb2eb79450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-844433bf-8366-4019-a072-6d51997fd5ee req-deb35349-944e-4ca8-98f9-c961797a6be4 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Detach interface failed, port_id=8a38f353-bd3b-4a59-a4d3-04728260fdf4, reason: Instance c9422249-ff7a-455e-87e1-bdce3e0345f1 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:33:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-deleted-13a5c008-7743-43d9-89d9-79cb2eb79450 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:44 user nova-compute[75000]: INFO nova.compute.manager [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Neutron deleted interface 13a5c008-7743-43d9-89d9-79cb2eb79450; detaching it from the instance and deleting it from the info cache
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [{"id": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "address": "fa:16:3e:c9:5f:ee", "network": {"id": "735f189b-f05d-4097-b884-9623beab8c1f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-176578374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd9c5b2-a5", "ovs_interfaceid": "edd9c5b2-a58a-40e1-a90b-3369f3956182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Detach interface failed, port_id=13a5c008-7743-43d9-89d9-79cb2eb79450, reason: Instance c9422249-ff7a-455e-87e1-bdce3e0345f1 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-deleted-edd9c5b2-a58a-40e1-a90b-3369f3956182 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:44 user nova-compute[75000]: INFO nova.compute.manager [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Neutron deleted interface edd9c5b2-a58a-40e1-a90b-3369f3956182; detaching it from the instance and deleting it from the info cache
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [{"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba040a18-e2d6-4599-a641-f459aed99c3c", "address": "fa:16:3e:df:f2:81", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba040a18-e2", "ovs_interfaceid": "ba040a18-e2d6-4599-a641-f459aed99c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Detach interface failed, port_id=edd9c5b2-a58a-40e1-a90b-3369f3956182, reason: Instance c9422249-ff7a-455e-87e1-bdce3e0345f1 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-deleted-ba040a18-e2d6-4599-a641-f459aed99c3c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:44 user nova-compute[75000]: INFO nova.compute.manager [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Neutron deleted interface ba040a18-e2d6-4599-a641-f459aed99c3c; detaching it from the instance and deleting it from the info cache
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [{"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "address": "fa:16:3e:6d:53:4a", "network": {"id": "d4f05b48-ab49-4596-8c0a-1db8da677cd1", "bridge": "br-int", "label": "tempest-device-tagging-net2-567443219", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b17d3f3-90", "ovs_interfaceid": "5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:44 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Took 4.59 seconds to deallocate network for instance.
Nov 06 22:33:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-a9d73dba-961d-4e0e-90e5-c1c718e92dbd req-7e806c2c-1926-48b8-984a-28fa86cab78f service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Detach interface failed, port_id=ba040a18-e2d6-4599-a641-f459aed99c3c, reason: Instance c9422249-ff7a-455e-87e1-bdce3e0345f1 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:33:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquiring lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:33:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:33:45 user nova-compute[75000]: INFO nova.compute.claims [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Claim successful on node user
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-f913c0ad-3b87-473b-a2ad-5edeac7a0a52 req-42b69caf-0955-4a52-bf9c-2d8f7b441366 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Received event network-vif-deleted-5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:46 user nova-compute[75000]: INFO nova.compute.manager [req-f913c0ad-3b87-473b-a2ad-5edeac7a0a52 req-42b69caf-0955-4a52-bf9c-2d8f7b441366 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Neutron deleted interface 5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727; detaching it from the instance and deleting it from the info cache
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.network.neutron [req-f913c0ad-3b87-473b-a2ad-5edeac7a0a52 req-42b69caf-0955-4a52-bf9c-2d8f7b441366 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Updating instance_info_cache with network_info: [{"id": "e1a63239-aa0a-4355-9199-1b1def6d7343", "address": "fa:16:3e:99:47:a9", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a63239-aa", "ovs_interfaceid": "e1a63239-aa0a-4355-9199-1b1def6d7343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "address": "fa:16:3e:6d:b4:6d", "network": {"id": "26ae18e6-4448-405e-9a79-2fec9c183069", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072701196", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af4172b6528d4cb282b1906ef73fadf2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5aefaa0-9a", "ovs_interfaceid": "f5aefaa0-9af2-47b8-bcd2-3c572594b338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-f913c0ad-3b87-473b-a2ad-5edeac7a0a52 req-42b69caf-0955-4a52-bf9c-2d8f7b441366 service nova] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Detach interface failed, port_id=5b17d3f3-9016-4fe2-8a4f-a8a5fffb6727, reason: Instance c9422249-ff7a-455e-87e1-bdce3e0345f1 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:33:46 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:33:46 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Creating image(s)
Nov 06 22:33:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquiring lock "/opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "/opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "/opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG nova.policy [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47f1f9b260fd45d1b880c6a61bf41ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5af326b8dc4db1a32887b2c76b2790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.236s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.262s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk 1073741824" returned: 0 in 0.071s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:47 user nova-compute[75000]: INFO nova.compute.manager [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] [instance: c9422249-ff7a-455e-87e1-bdce3e0345f1] Took 3.06 seconds to detach 3 volumes for instance.
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Successfully created port: 3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Cannot resize image /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Ensure instance console log exists: /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:33:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.633s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:48 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Deleted allocations for instance c9422249-ff7a-455e-87e1-bdce3e0345f1
Nov 06 22:33:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-03c6c5f1-67ca-4242-9249-dd7c206795ed tempest-TaggedBootDevicesTest_v242-263042162 tempest-TaggedBootDevicesTest_v242-263042162-project-member] Lock "c9422249-ff7a-455e-87e1-bdce3e0345f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.322s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Successfully updated port: 3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquiring lock "refresh_cache-0efe3b45-ff8f-48fa-ab0f-822fb64b7272" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquired lock "refresh_cache-0efe3b45-ff8f-48fa-ab0f-822fb64b7272" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-3316686d-80b3-4136-8d57-b8d4cbd007eb req-2ab009ba-16c9-45c8-9b18-c68164b93fbe service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received event network-changed-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-3316686d-80b3-4136-8d57-b8d4cbd007eb req-2ab009ba-16c9-45c8-9b18-c68164b93fbe service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Refreshing instance network info cache due to event network-changed-3d9b1f08-e420-41fc-8e63-b09154b63f76. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3316686d-80b3-4136-8d57-b8d4cbd007eb req-2ab009ba-16c9-45c8-9b18-c68164b93fbe service nova] Acquiring lock "refresh_cache-0efe3b45-ff8f-48fa-ab0f-822fb64b7272" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Updating instance_info_cache with network_info: [{"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Releasing lock "refresh_cache-0efe3b45-ff8f-48fa-ab0f-822fb64b7272" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Instance network_info: |[{"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3316686d-80b3-4136-8d57-b8d4cbd007eb req-2ab009ba-16c9-45c8-9b18-c68164b93fbe service nova] Acquired lock "refresh_cache-0efe3b45-ff8f-48fa-ab0f-822fb64b7272" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.neutron [req-3316686d-80b3-4136-8d57-b8d4cbd007eb req-2ab009ba-16c9-45c8-9b18-c68164b93fbe service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Refreshing network info cache for port 3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Start _get_guest_xml network_info=[{"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:33:48 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:33:48 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1267663327',display_name='tempest-VolumesNegativeTest-instance-1267663327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1267663327',id=22,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d5af326b8dc4db1a32887b2c76b2790',ramdisk_id='',reservation_id='r-fr5kmj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1139098273',owner_user_name='tempest-VolumesNegativeTest-1139098273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:33:47Z,user_data=None,user_id='47f1f9b260fd45d1b880c6a61bf41ad0',uuid=0efe3b45-ff8f-48fa-ab0f-822fb64b7272,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Converting VIF {"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b7:18,bridge_name='br-int',has_traffic_filtering=True,id=3d9b1f08-e420-41fc-8e63-b09154b63f76,network=Network(d6eef2c0-b6e9-44c6-98c4-a262032c8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b1f08-e4') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.objects.instance [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lazy-loading 'pci_devices' on Instance uuid 0efe3b45-ff8f-48fa-ab0f-822fb64b7272 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:33:48 user nova-compute[75000]:   <uuid>0efe3b45-ff8f-48fa-ab0f-822fb64b7272</uuid>
Nov 06 22:33:48 user nova-compute[75000]:   <name>instance-00000016</name>
Nov 06 22:33:48 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:33:48 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:33:48 user nova-compute[75000]:   <metadata>
Nov 06 22:33:48 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:33:48 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:33:48 user nova-compute[75000]:       <nova:name>tempest-VolumesNegativeTest-instance-1267663327</nova:name>
Nov 06 22:33:48 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:33:48</nova:creationTime>
Nov 06 22:33:48 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:33:48 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:33:48 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:33:48 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:33:48 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:33:48 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:33:48 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:33:48 user nova-compute[75000]:       <nova:owner>
Nov 06 22:33:48 user nova-compute[75000]:         <nova:user uuid="47f1f9b260fd45d1b880c6a61bf41ad0">tempest-VolumesNegativeTest-1139098273-project-member</nova:user>
Nov 06 22:33:48 user nova-compute[75000]:         <nova:project uuid="2d5af326b8dc4db1a32887b2c76b2790">tempest-VolumesNegativeTest-1139098273</nova:project>
Nov 06 22:33:48 user nova-compute[75000]:       </nova:owner>
Nov 06 22:33:48 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:33:48 user nova-compute[75000]:       <nova:ports>
Nov 06 22:33:48 user nova-compute[75000]:         <nova:port uuid="3d9b1f08-e420-41fc-8e63-b09154b63f76">
Nov 06 22:33:48 user nova-compute[75000]:           <nova:ip type="fixed" address="192.168.233.32" ipVersion="4"/>
Nov 06 22:33:48 user nova-compute[75000]:         </nova:port>
Nov 06 22:33:48 user nova-compute[75000]:       </nova:ports>
Nov 06 22:33:48 user nova-compute[75000]:     </nova:instance>
Nov 06 22:33:48 user nova-compute[75000]:   </metadata>
Nov 06 22:33:48 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:33:48 user nova-compute[75000]:     <system>
Nov 06 22:33:48 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:33:48 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:33:48 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:33:48 user nova-compute[75000]:       <entry name="serial">0efe3b45-ff8f-48fa-ab0f-822fb64b7272</entry>
Nov 06 22:33:48 user nova-compute[75000]:       <entry name="uuid">0efe3b45-ff8f-48fa-ab0f-822fb64b7272</entry>
Nov 06 22:33:48 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:33:48 user nova-compute[75000]:     </system>
Nov 06 22:33:48 user nova-compute[75000]:   </sysinfo>
Nov 06 22:33:48 user nova-compute[75000]:   <os>
Nov 06 22:33:48 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:33:48 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:33:48 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:33:48 user nova-compute[75000]:   </os>
Nov 06 22:33:48 user nova-compute[75000]:   <features>
Nov 06 22:33:48 user nova-compute[75000]:     <acpi/>
Nov 06 22:33:48 user nova-compute[75000]:     <apic/>
Nov 06 22:33:48 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:33:48 user nova-compute[75000]:   </features>
Nov 06 22:33:48 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:33:48 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:33:48 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:33:48 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:33:48 user nova-compute[75000]:   </clock>
Nov 06 22:33:48 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:33:48 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:33:48 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:33:48 user nova-compute[75000]:   </cpu>
Nov 06 22:33:48 user nova-compute[75000]:   <devices>
Nov 06 22:33:48 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:33:48 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:33:48 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk"/>
Nov 06 22:33:48 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:33:48 user nova-compute[75000]:     </disk>
Nov 06 22:33:48 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:33:48 user nova-compute[75000]:       <mac address="fa:16:3e:1e:b7:18"/>
Nov 06 22:33:48 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:48 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:33:48 user nova-compute[75000]:       <target dev="tap3d9b1f08-e4"/>
Nov 06 22:33:48 user nova-compute[75000]:     </interface>
Nov 06 22:33:48 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:33:48 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/console.log" append="off"/>
Nov 06 22:33:48 user nova-compute[75000]:     </serial>
Nov 06 22:33:48 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:33:48 user nova-compute[75000]:     <video>
Nov 06 22:33:48 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:33:48 user nova-compute[75000]:     </video>
Nov 06 22:33:48 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:33:48 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:33:48 user nova-compute[75000]:     </rng>
Nov 06 22:33:48 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:33:48 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:33:48 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:33:48 user nova-compute[75000]:     </memballoon>
Nov 06 22:33:48 user nova-compute[75000]:   </devices>
Nov 06 22:33:48 user nova-compute[75000]: </domain>
Nov 06 22:33:48 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1267663327',display_name='tempest-VolumesNegativeTest-instance-1267663327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1267663327',id=22,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d5af326b8dc4db1a32887b2c76b2790',ramdisk_id='',reservation_id='r-fr5kmj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1139098273',owner_user_name='tempest-VolumesNegativeTest-1139098273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:33:47Z,user_data=None,user_id='47f1f9b260fd45d1b880c6a61bf41ad0',uuid=0efe3b45-ff8f-48fa-ab0f-822fb64b7272,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Converting VIF {"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b7:18,bridge_name='br-int',has_traffic_filtering=True,id=3d9b1f08-e420-41fc-8e63-b09154b63f76,network=Network(d6eef2c0-b6e9-44c6-98c4-a262032c8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b1f08-e4') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG os_vif [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b7:18,bridge_name='br-int',has_traffic_filtering=True,id=3d9b1f08-e420-41fc-8e63-b09154b63f76,network=Network(d6eef2c0-b6e9-44c6-98c4-a262032c8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b1f08-e4') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bffa383-1559-5fa0-8743-87f9bd610116', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d9b1f08-e4, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d9b1f08-e4, col_values=(('qos', UUID('2926a2a8-dc7a-4106-93d8-611d751aa09d')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d9b1f08-e4, col_values=(('external_ids', {'iface-id': '3d9b1f08-e420-41fc-8e63-b09154b63f76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:b7:18', 'vm-uuid': '0efe3b45-ff8f-48fa-ab0f-822fb64b7272'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:48 user nova-compute[75000]: INFO os_vif [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b7:18,bridge_name='br-int',has_traffic_filtering=True,id=3d9b1f08-e420-41fc-8e63-b09154b63f76,network=Network(d6eef2c0-b6e9-44c6-98c4-a262032c8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b1f08-e4')
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] No VIF found with MAC fa:16:3e:1e:b7:18, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.neutron [req-3316686d-80b3-4136-8d57-b8d4cbd007eb req-2ab009ba-16c9-45c8-9b18-c68164b93fbe service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Updated VIF entry in instance network info cache for port 3d9b1f08-e420-41fc-8e63-b09154b63f76. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG nova.network.neutron [req-3316686d-80b3-4136-8d57-b8d4cbd007eb req-2ab009ba-16c9-45c8-9b18-c68164b93fbe service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Updating instance_info_cache with network_info: [{"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3316686d-80b3-4136-8d57-b8d4cbd007eb req-2ab009ba-16c9-45c8-9b18-c68164b93fbe service nova] Releasing lock "refresh_cache-0efe3b45-ff8f-48fa-ab0f-822fb64b7272" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:33:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-31b26507-985b-43c6-bb93-9b938f8c7b28 req-537b1fec-70a9-4773-8de2-75f433dcb126 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received event network-vif-plugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-31b26507-985b-43c6-bb93-9b938f8c7b28 req-537b1fec-70a9-4773-8de2-75f433dcb126 service nova] Acquiring lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-31b26507-985b-43c6-bb93-9b938f8c7b28 req-537b1fec-70a9-4773-8de2-75f433dcb126 service nova] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-31b26507-985b-43c6-bb93-9b938f8c7b28 req-537b1fec-70a9-4773-8de2-75f433dcb126 service nova] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-31b26507-985b-43c6-bb93-9b938f8c7b28 req-537b1fec-70a9-4773-8de2-75f433dcb126 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] No waiting events found dispatching network-vif-plugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:50 user nova-compute[75000]: WARNING nova.compute.manager [req-31b26507-985b-43c6-bb93-9b938f8c7b28 req-537b1fec-70a9-4773-8de2-75f433dcb126 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received unexpected event network-vif-plugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 for instance with vm_state building and task_state spawning.
Nov 06 22:33:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:33:52 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Instance spawned successfully.
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:33:52 user nova-compute[75000]: INFO nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:33:52 user nova-compute[75000]: INFO nova.compute.manager [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Took 6.67 seconds to build instance.
Nov 06 22:33:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d599b8db-e20f-451b-a0de-b54f5350ecaa tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.768s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.compute.manager [req-085c4f41-0062-411f-8e8c-6f3d76bcece4 req-c018a3a8-e3e2-4a86-b197-a072ca6a2888 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received event network-vif-plugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-085c4f41-0062-411f-8e8c-6f3d76bcece4 req-c018a3a8-e3e2-4a86-b197-a072ca6a2888 service nova] Acquiring lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-085c4f41-0062-411f-8e8c-6f3d76bcece4 req-c018a3a8-e3e2-4a86-b197-a072ca6a2888 service nova] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-085c4f41-0062-411f-8e8c-6f3d76bcece4 req-c018a3a8-e3e2-4a86-b197-a072ca6a2888 service nova] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:52 user nova-compute[75000]: DEBUG nova.compute.manager [req-085c4f41-0062-411f-8e8c-6f3d76bcece4 req-c018a3a8-e3e2-4a86-b197-a072ca6a2888 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] No waiting events found dispatching network-vif-plugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:52 user nova-compute[75000]: WARNING nova.compute.manager [req-085c4f41-0062-411f-8e8c-6f3d76bcece4 req-c018a3a8-e3e2-4a86-b197-a072ca6a2888 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received unexpected event network-vif-plugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 for instance with vm_state active and task_state None.
Nov 06 22:33:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:56 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0414d03a-aba0-44df-9cca-257ab81bde61 is timed out.
Nov 06 22:33:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Successfully detached device vdb from instance 0414d03a-aba0-44df-9cca-257ab81bde61 from the live domain config.
Nov 06 22:33:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJWiBPSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:33:56 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b553c410-f9dd-40bd-9059-35cdea825aee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:33:56 user nova-compute[75000]: No targets found.
Nov 06 22:33:56 user nova-compute[75000]: iSNS:
Nov 06 22:33:56 user nova-compute[75000]: No targets found.
Nov 06 22:33:56 user nova-compute[75000]: STATIC:
Nov 06 22:33:56 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76
Nov 06 22:33:56 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:56 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:56 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:33:56 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:56 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:56 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69
Nov 06 22:33:56 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:56 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:56 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:33:56 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:56 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:56 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:33:56 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:56 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:56 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320
Nov 06 22:33:56 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:56 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:56 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0
Nov 06 22:33:56 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:33:56 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:33:56 user nova-compute[75000]: FIRMWARE:
Nov 06 22:33:56 user nova-compute[75000]: No targets found.
Nov 06 22:33:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:33:56 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:33:56 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f133182-06f1-47bc-aac6-d08d83c5c418]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dfc9c4-f62d-4630-86e9-25665564ccd9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:33:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc23d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69'): ({'sdk'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Removing single pathed devices sdk {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[27912c8b-666a-43fa-a178-022669ae9c00]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba76b4f-023d-4108-8551-22187c9f8ce5]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Flushing IO for device /dev/sdk {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[83194a5d-3ecf-4ac1-950b-3bd217f5d75b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.037s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b99642e-98e7-4b5b-b965-05e183b46205]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] SCSI volumes sdk have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8645a7-5a3c-4861-aeaf-6f8d99297033]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ec8552-537c-4d4b-bfc9-50aa91c78664]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69, portal: 172.16.0.220,3260]
Nov 06 22:33:56 user nova-compute[75000]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69, portal: 172.16.0.220,3260] successful.
Nov 06 22:33:56 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e0cfc65-a19c-4443-8f7d-21d28214de69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94c71d0-23d9-43d9-ad41-7ce82b439fe7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] <== disconnect_volume: return (346ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:33:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "98957082-bdb6-472c-9462-f3e8d7340a20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98957082-bdb6-472c-9462-f3e8d7340a20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:57 user nova-compute[75000]: INFO nova.compute.manager [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Terminating instance
Nov 06 22:33:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-41814b0e-d43a-4227-b873-892b84649fef req-da3e9594-a8ef-4fa7-a61d-696876a087cd service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received event network-vif-unplugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-41814b0e-d43a-4227-b873-892b84649fef req-da3e9594-a8ef-4fa7-a61d-696876a087cd service nova] Acquiring lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-41814b0e-d43a-4227-b873-892b84649fef req-da3e9594-a8ef-4fa7-a61d-696876a087cd service nova] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-41814b0e-d43a-4227-b873-892b84649fef req-da3e9594-a8ef-4fa7-a61d-696876a087cd service nova] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-41814b0e-d43a-4227-b873-892b84649fef req-da3e9594-a8ef-4fa7-a61d-696876a087cd service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] No waiting events found dispatching network-vif-unplugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-41814b0e-d43a-4227-b873-892b84649fef req-da3e9594-a8ef-4fa7-a61d-696876a087cd service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received event network-vif-unplugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Instance destroyed successfully.
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.objects.instance [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lazy-loading 'resources' on Instance uuid 98957082-bdb6-472c-9462-f3e8d7340a20 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.objects.instance [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lazy-loading 'flavor' on Instance uuid 0414d03a-aba0-44df-9cca-257ab81bde61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1784111207',display_name='tempest-ServersNegativeTestJSON-server-1784111207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1784111207',id=20,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='248d06b9dfbf4cd69d8d9630aea9ab36',ramdisk_id='',reservation_id='r-92xa940o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1355389518',owner_user_name='tempest-ServersNegativeTestJSON-1355389518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:32:15Z,user_data=None,user_id='20cf456ef1044f7387512475b494365e',uuid=98957082-bdb6-472c-9462-f3e8d7340a20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converting VIF {"id": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "address": "fa:16:3e:ee:47:0a", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cacef1c-52", "ovs_interfaceid": "6cacef1c-52d0-4527-80b6-4c22a783e8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:47:0a,bridge_name='br-int',has_traffic_filtering=True,id=6cacef1c-52d0-4527-80b6-4c22a783e8e8,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cacef1c-52') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG os_vif [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:47:0a,bridge_name='br-int',has_traffic_filtering=True,id=6cacef1c-52d0-4527-80b6-4c22a783e8e8,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cacef1c-52') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cacef1c-52, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5d61ede-16d2-4d20-9fc6-c259a78ffac2) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:33:58 user nova-compute[75000]: INFO os_vif [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:47:0a,bridge_name='br-int',has_traffic_filtering=True,id=6cacef1c-52d0-4527-80b6-4c22a783e8e8,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cacef1c-52')
Nov 06 22:33:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Deleting instance files /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20_del
Nov 06 22:33:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Deletion of /opt/stack/data/nova/instances/98957082-bdb6-472c-9462-f3e8d7340a20_del complete
Nov 06 22:33:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-68cb49d1-b28d-46db-bc37-8624894921ab tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.367s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:58 user nova-compute[75000]: INFO nova.compute.manager [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 06 22:33:58 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-c5f5dcd8-3a62-4373-812e-8fce3b0a8d75 req-aedc1cb5-079a-4fe2-90c3-a641b04a7c01 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received event network-vif-deleted-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:58 user nova-compute[75000]: INFO nova.compute.manager [req-c5f5dcd8-3a62-4373-812e-8fce3b0a8d75 req-aedc1cb5-079a-4fe2-90c3-a641b04a7c01 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Neutron deleted interface 6cacef1c-52d0-4527-80b6-4c22a783e8e8; detaching it from the instance and deleting it from the info cache
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.network.neutron [req-c5f5dcd8-3a62-4373-812e-8fce3b0a8d75 req-aedc1cb5-079a-4fe2-90c3-a641b04a7c01 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:33:58 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Took 0.48 seconds to deallocate network for instance.
Nov 06 22:33:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-c5f5dcd8-3a62-4373-812e-8fce3b0a8d75 req-aedc1cb5-079a-4fe2-90c3-a641b04a7c01 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Detach interface failed, port_id=6cacef1c-52d0-4527-80b6-4c22a783e8e8, reason: Instance 98957082-bdb6-472c-9462-f3e8d7340a20 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:59 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:33:59 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:33:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:59 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Deleted allocations for instance 98957082-bdb6-472c-9462-f3e8d7340a20
Nov 06 22:33:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9b252627-aa3c-4084-8be5-3d335f50d7da tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "98957082-bdb6-472c-9462-f3e8d7340a20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.148s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-0914affd-434c-4a47-be2b-a20a99b605dd req-c80ad68a-dbcd-4be6-8c9e-c7a83de29b49 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received event network-vif-plugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:33:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0914affd-434c-4a47-be2b-a20a99b605dd req-c80ad68a-dbcd-4be6-8c9e-c7a83de29b49 service nova] Acquiring lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:33:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0914affd-434c-4a47-be2b-a20a99b605dd req-c80ad68a-dbcd-4be6-8c9e-c7a83de29b49 service nova] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:33:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0914affd-434c-4a47-be2b-a20a99b605dd req-c80ad68a-dbcd-4be6-8c9e-c7a83de29b49 service nova] Lock "98957082-bdb6-472c-9462-f3e8d7340a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:33:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-0914affd-434c-4a47-be2b-a20a99b605dd req-c80ad68a-dbcd-4be6-8c9e-c7a83de29b49 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] No waiting events found dispatching network-vif-plugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:33:59 user nova-compute[75000]: WARNING nova.compute.manager [req-0914affd-434c-4a47-be2b-a20a99b605dd req-c80ad68a-dbcd-4be6-8c9e-c7a83de29b49 service nova] [instance: 98957082-bdb6-472c-9462-f3e8d7340a20] Received unexpected event network-vif-plugged-6cacef1c-52d0-4527-80b6-4c22a783e8e8 for instance with vm_state deleted and task_state None.
Nov 06 22:33:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "9e161f93-64e3-4807-8811-d7d6ba821ca9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:34:05 user nova-compute[75000]: INFO nova.compute.claims [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Claim successful on node user
Nov 06 22:34:05 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:34:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:34:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:34:05 user nova-compute[75000]: DEBUG nova.policy [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddbbf039233142eca9f4cdfe2396da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a8c838f784f309fb9f0066e3463ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:34:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Creating image(s)
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "/opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "/opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Successfully created port: d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk 1073741824" returned: 0 in 0.057s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Cannot resize image /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Ensure instance console log exists: /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Successfully updated port: d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "refresh_cache-9e161f93-64e3-4807-8811-d7d6ba821ca9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquired lock "refresh_cache-9e161f93-64e3-4807-8811-d7d6ba821ca9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-b61072c7-c043-4d42-baef-657e6ec785ad req-648c1943-8b36-4ffd-8dd9-4f212ed85999 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received event network-changed-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-b61072c7-c043-4d42-baef-657e6ec785ad req-648c1943-8b36-4ffd-8dd9-4f212ed85999 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Refreshing instance network info cache due to event network-changed-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b61072c7-c043-4d42-baef-657e6ec785ad req-648c1943-8b36-4ffd-8dd9-4f212ed85999 service nova] Acquiring lock "refresh_cache-9e161f93-64e3-4807-8811-d7d6ba821ca9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Updating instance_info_cache with network_info: [{"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Releasing lock "refresh_cache-9e161f93-64e3-4807-8811-d7d6ba821ca9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Instance network_info: |[{"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b61072c7-c043-4d42-baef-657e6ec785ad req-648c1943-8b36-4ffd-8dd9-4f212ed85999 service nova] Acquired lock "refresh_cache-9e161f93-64e3-4807-8811-d7d6ba821ca9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-b61072c7-c043-4d42-baef-657e6ec785ad req-648c1943-8b36-4ffd-8dd9-4f212ed85999 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Refreshing network info cache for port d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Start _get_guest_xml network_info=[{"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:34:07 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:34:07 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1473309591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1473309591',id=23,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-3mxzwtas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:34:06Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=9e161f93-64e3-4807-8811-d7d6ba821ca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=d7436fc9-b4b3-4b82-aa01-aac71e6aafb9,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7436fc9-b4') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.objects.instance [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e161f93-64e3-4807-8811-d7d6ba821ca9 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:34:07 user nova-compute[75000]:   <uuid>9e161f93-64e3-4807-8811-d7d6ba821ca9</uuid>
Nov 06 22:34:07 user nova-compute[75000]:   <name>instance-00000017</name>
Nov 06 22:34:07 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:34:07 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:34:07 user nova-compute[75000]:   <metadata>
Nov 06 22:34:07 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:34:07 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:34:07 user nova-compute[75000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1473309591</nova:name>
Nov 06 22:34:07 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:34:07</nova:creationTime>
Nov 06 22:34:07 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:34:07 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:34:07 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:34:07 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:34:07 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:34:07 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:34:07 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:34:07 user nova-compute[75000]:       <nova:owner>
Nov 06 22:34:07 user nova-compute[75000]:         <nova:user uuid="ddbbf039233142eca9f4cdfe2396da7c">tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member</nova:user>
Nov 06 22:34:07 user nova-compute[75000]:         <nova:project uuid="3a7a8c838f784f309fb9f0066e3463ae">tempest-ServerBootFromVolumeStableRescueTest-294256413</nova:project>
Nov 06 22:34:07 user nova-compute[75000]:       </nova:owner>
Nov 06 22:34:07 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:34:07 user nova-compute[75000]:       <nova:ports>
Nov 06 22:34:07 user nova-compute[75000]:         <nova:port uuid="d7436fc9-b4b3-4b82-aa01-aac71e6aafb9">
Nov 06 22:34:07 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:34:07 user nova-compute[75000]:         </nova:port>
Nov 06 22:34:07 user nova-compute[75000]:       </nova:ports>
Nov 06 22:34:07 user nova-compute[75000]:     </nova:instance>
Nov 06 22:34:07 user nova-compute[75000]:   </metadata>
Nov 06 22:34:07 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:34:07 user nova-compute[75000]:     <system>
Nov 06 22:34:07 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:34:07 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:34:07 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:34:07 user nova-compute[75000]:       <entry name="serial">9e161f93-64e3-4807-8811-d7d6ba821ca9</entry>
Nov 06 22:34:07 user nova-compute[75000]:       <entry name="uuid">9e161f93-64e3-4807-8811-d7d6ba821ca9</entry>
Nov 06 22:34:07 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:34:07 user nova-compute[75000]:     </system>
Nov 06 22:34:07 user nova-compute[75000]:   </sysinfo>
Nov 06 22:34:07 user nova-compute[75000]:   <os>
Nov 06 22:34:07 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:34:07 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:34:07 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:34:07 user nova-compute[75000]:   </os>
Nov 06 22:34:07 user nova-compute[75000]:   <features>
Nov 06 22:34:07 user nova-compute[75000]:     <acpi/>
Nov 06 22:34:07 user nova-compute[75000]:     <apic/>
Nov 06 22:34:07 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:34:07 user nova-compute[75000]:   </features>
Nov 06 22:34:07 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:34:07 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:34:07 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:34:07 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:34:07 user nova-compute[75000]:   </clock>
Nov 06 22:34:07 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:34:07 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:34:07 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:34:07 user nova-compute[75000]:   </cpu>
Nov 06 22:34:07 user nova-compute[75000]:   <devices>
Nov 06 22:34:07 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:34:07 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:34:07 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk"/>
Nov 06 22:34:07 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:34:07 user nova-compute[75000]:     </disk>
Nov 06 22:34:07 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:34:07 user nova-compute[75000]:       <mac address="fa:16:3e:cf:61:5f"/>
Nov 06 22:34:07 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:34:07 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:34:07 user nova-compute[75000]:       <target dev="tapd7436fc9-b4"/>
Nov 06 22:34:07 user nova-compute[75000]:     </interface>
Nov 06 22:34:07 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:34:07 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/console.log" append="off"/>
Nov 06 22:34:07 user nova-compute[75000]:     </serial>
Nov 06 22:34:07 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:34:07 user nova-compute[75000]:     <video>
Nov 06 22:34:07 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:34:07 user nova-compute[75000]:     </video>
Nov 06 22:34:07 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:34:07 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:34:07 user nova-compute[75000]:     </rng>
Nov 06 22:34:07 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:34:07 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:34:07 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:34:07 user nova-compute[75000]:     </memballoon>
Nov 06 22:34:07 user nova-compute[75000]:   </devices>
Nov 06 22:34:07 user nova-compute[75000]: </domain>
Nov 06 22:34:07 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1473309591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1473309591',id=23,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-3mxzwtas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:34:06Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=9e161f93-64e3-4807-8811-d7d6ba821ca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=d7436fc9-b4b3-4b82-aa01-aac71e6aafb9,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7436fc9-b4') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG os_vif [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=d7436fc9-b4b3-4b82-aa01-aac71e6aafb9,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7436fc9-b4') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '961ba85b-88a6-5476-ad62-20591a723204', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7436fc9-b4, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7436fc9-b4, col_values=(('qos', UUID('81b65467-fa2d-494a-ac63-65309aaecf9d')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7436fc9-b4, col_values=(('external_ids', {'iface-id': 'd7436fc9-b4b3-4b82-aa01-aac71e6aafb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:61:5f', 'vm-uuid': '9e161f93-64e3-4807-8811-d7d6ba821ca9'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:07 user nova-compute[75000]: INFO os_vif [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=d7436fc9-b4b3-4b82-aa01-aac71e6aafb9,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7436fc9-b4')
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No VIF found with MAC fa:16:3e:cf:61:5f, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-b61072c7-c043-4d42-baef-657e6ec785ad req-648c1943-8b36-4ffd-8dd9-4f212ed85999 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Updated VIF entry in instance network info cache for port d7436fc9-b4b3-4b82-aa01-aac71e6aafb9. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-b61072c7-c043-4d42-baef-657e6ec785ad req-648c1943-8b36-4ffd-8dd9-4f212ed85999 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Updating instance_info_cache with network_info: [{"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b61072c7-c043-4d42-baef-657e6ec785ad req-648c1943-8b36-4ffd-8dd9-4f212ed85999 service nova] Releasing lock "refresh_cache-9e161f93-64e3-4807-8811-d7d6ba821ca9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:34:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-414c6317-59ed-4527-ab45-d3f0c2c1de93 req-3f5360f8-8705-4fa7-a0d2-9cb56d1a1a6e service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received event network-vif-plugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-414c6317-59ed-4527-ab45-d3f0c2c1de93 req-3f5360f8-8705-4fa7-a0d2-9cb56d1a1a6e service nova] Acquiring lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-414c6317-59ed-4527-ab45-d3f0c2c1de93 req-3f5360f8-8705-4fa7-a0d2-9cb56d1a1a6e service nova] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-414c6317-59ed-4527-ab45-d3f0c2c1de93 req-3f5360f8-8705-4fa7-a0d2-9cb56d1a1a6e service nova] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-414c6317-59ed-4527-ab45-d3f0c2c1de93 req-3f5360f8-8705-4fa7-a0d2-9cb56d1a1a6e service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] No waiting events found dispatching network-vif-plugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:09 user nova-compute[75000]: WARNING nova.compute.manager [req-414c6317-59ed-4527-ab45-d3f0c2c1de93 req-3f5360f8-8705-4fa7-a0d2-9cb56d1a1a6e service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received unexpected event network-vif-plugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 for instance with vm_state building and task_state spawning.
Nov 06 22:34:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:34:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Instance spawned successfully.
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:11 user nova-compute[75000]: INFO nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-265bceb1-70b9-4fd6-89c1-fe6fc4a7d150 req-8eef2c1a-384f-441a-a1e7-d5708404b640 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received event network-vif-plugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-265bceb1-70b9-4fd6-89c1-fe6fc4a7d150 req-8eef2c1a-384f-441a-a1e7-d5708404b640 service nova] Acquiring lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-265bceb1-70b9-4fd6-89c1-fe6fc4a7d150 req-8eef2c1a-384f-441a-a1e7-d5708404b640 service nova] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-265bceb1-70b9-4fd6-89c1-fe6fc4a7d150 req-8eef2c1a-384f-441a-a1e7-d5708404b640 service nova] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-265bceb1-70b9-4fd6-89c1-fe6fc4a7d150 req-8eef2c1a-384f-441a-a1e7-d5708404b640 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] No waiting events found dispatching network-vif-plugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:11 user nova-compute[75000]: WARNING nova.compute.manager [req-265bceb1-70b9-4fd6-89c1-fe6fc4a7d150 req-8eef2c1a-384f-441a-a1e7-d5708404b640 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received unexpected event network-vif-plugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 for instance with vm_state building and task_state spawning.
Nov 06 22:34:11 user nova-compute[75000]: INFO nova.compute.manager [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Took 5.96 seconds to build instance.
Nov 06 22:34:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2e9f9f46-0602-4a5c-95e9-4a769c8a2677 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.065s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:34:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:34:17 user nova-compute[75000]: INFO nova.compute.claims [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Claim successful on node user
Nov 06 22:34:18 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:34:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:34:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG nova.policy [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f50e6a64752e488b9699a8bdda46253c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4b9d5ecee54acb8ca3534a38500b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:34:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Creating image(s)
Nov 06 22:34:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk 1073741824" returned: 0 in 0.054s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Successfully created port: 7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Cannot resize image /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Ensure instance console log exists: /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Successfully updated port: 7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquired lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-2596bdcb-e5b1-4f78-9698-91a86800601c req-fc94711f-5636-4eac-8199-86de60efed88 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-changed-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-2596bdcb-e5b1-4f78-9698-91a86800601c req-fc94711f-5636-4eac-8199-86de60efed88 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Refreshing instance network info cache due to event network-changed-7d134985-3e0b-4352-a829-46cc9efcaaa3. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2596bdcb-e5b1-4f78-9698-91a86800601c req-fc94711f-5636-4eac-8199-86de60efed88 service nova] Acquiring lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.network.neutron [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updating instance_info_cache with network_info: [{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Releasing lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Instance network_info: |[{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2596bdcb-e5b1-4f78-9698-91a86800601c req-fc94711f-5636-4eac-8199-86de60efed88 service nova] Acquired lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.network.neutron [req-2596bdcb-e5b1-4f78-9698-91a86800601c req-fc94711f-5636-4eac-8199-86de60efed88 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Refreshing network info cache for port 7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Start _get_guest_xml network_info=[{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:34:20 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:34:20 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-767875355',display_name='tempest-ServerRescueNegativeTestJSON-server-767875355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-767875355',id=24,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdTqiSrMqRl+yglj84awVX1hdMP+cCKbd7CLQXPSJ3xZ+8VIStP539jNk65vUlH6hoLPRWMdxprcJ8AVIS+526F1aYdGyOUIMI+uHEm3yCZPpspfjLampZy1EaJS8pbcg==',key_name='tempest-keypair-340254793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-pifvb90z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:34:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f50e6a64752e488b9699a8bdda46253c',uuid=3dfe6744-55ec-4294-8fda-5689879ed46b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:2e:d2,bridge_name='br-int',has_traffic_filtering=True,id=7d134985-3e0b-4352-a829-46cc9efcaaa3,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d134985-3e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:34:20 user nova-compute[75000]:   <uuid>3dfe6744-55ec-4294-8fda-5689879ed46b</uuid>
Nov 06 22:34:20 user nova-compute[75000]:   <name>instance-00000018</name>
Nov 06 22:34:20 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:34:20 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:34:20 user nova-compute[75000]:   <metadata>
Nov 06 22:34:20 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:34:20 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:34:20 user nova-compute[75000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-767875355</nova:name>
Nov 06 22:34:20 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:34:20</nova:creationTime>
Nov 06 22:34:20 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:34:20 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:34:20 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:34:20 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:34:20 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:34:20 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:34:20 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:34:20 user nova-compute[75000]:       <nova:owner>
Nov 06 22:34:20 user nova-compute[75000]:         <nova:user uuid="f50e6a64752e488b9699a8bdda46253c">tempest-ServerRescueNegativeTestJSON-259573853-project-member</nova:user>
Nov 06 22:34:20 user nova-compute[75000]:         <nova:project uuid="5b4b9d5ecee54acb8ca3534a38500b4f">tempest-ServerRescueNegativeTestJSON-259573853</nova:project>
Nov 06 22:34:20 user nova-compute[75000]:       </nova:owner>
Nov 06 22:34:20 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:34:20 user nova-compute[75000]:       <nova:ports>
Nov 06 22:34:20 user nova-compute[75000]:         <nova:port uuid="7d134985-3e0b-4352-a829-46cc9efcaaa3">
Nov 06 22:34:20 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 22:34:20 user nova-compute[75000]:         </nova:port>
Nov 06 22:34:20 user nova-compute[75000]:       </nova:ports>
Nov 06 22:34:20 user nova-compute[75000]:     </nova:instance>
Nov 06 22:34:20 user nova-compute[75000]:   </metadata>
Nov 06 22:34:20 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:34:20 user nova-compute[75000]:     <system>
Nov 06 22:34:20 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:34:20 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:34:20 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:34:20 user nova-compute[75000]:       <entry name="serial">3dfe6744-55ec-4294-8fda-5689879ed46b</entry>
Nov 06 22:34:20 user nova-compute[75000]:       <entry name="uuid">3dfe6744-55ec-4294-8fda-5689879ed46b</entry>
Nov 06 22:34:20 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:34:20 user nova-compute[75000]:     </system>
Nov 06 22:34:20 user nova-compute[75000]:   </sysinfo>
Nov 06 22:34:20 user nova-compute[75000]:   <os>
Nov 06 22:34:20 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:34:20 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:34:20 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:34:20 user nova-compute[75000]:   </os>
Nov 06 22:34:20 user nova-compute[75000]:   <features>
Nov 06 22:34:20 user nova-compute[75000]:     <acpi/>
Nov 06 22:34:20 user nova-compute[75000]:     <apic/>
Nov 06 22:34:20 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:34:20 user nova-compute[75000]:   </features>
Nov 06 22:34:20 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:34:20 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:34:20 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:34:20 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:34:20 user nova-compute[75000]:   </clock>
Nov 06 22:34:20 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:34:20 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:34:20 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:34:20 user nova-compute[75000]:   </cpu>
Nov 06 22:34:20 user nova-compute[75000]:   <devices>
Nov 06 22:34:20 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:34:20 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:34:20 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk"/>
Nov 06 22:34:20 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:34:20 user nova-compute[75000]:     </disk>
Nov 06 22:34:20 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:34:20 user nova-compute[75000]:       <mac address="fa:16:3e:91:2e:d2"/>
Nov 06 22:34:20 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:34:20 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:34:20 user nova-compute[75000]:       <target dev="tap7d134985-3e"/>
Nov 06 22:34:20 user nova-compute[75000]:     </interface>
Nov 06 22:34:20 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:34:20 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/console.log" append="off"/>
Nov 06 22:34:20 user nova-compute[75000]:     </serial>
Nov 06 22:34:20 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:34:20 user nova-compute[75000]:     <video>
Nov 06 22:34:20 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:34:20 user nova-compute[75000]:     </video>
Nov 06 22:34:20 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:34:20 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:34:20 user nova-compute[75000]:     </rng>
Nov 06 22:34:20 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:34:20 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:34:20 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:34:20 user nova-compute[75000]:     </memballoon>
Nov 06 22:34:20 user nova-compute[75000]:   </devices>
Nov 06 22:34:20 user nova-compute[75000]: </domain>
Nov 06 22:34:20 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-767875355',display_name='tempest-ServerRescueNegativeTestJSON-server-767875355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-767875355',id=24,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdTqiSrMqRl+yglj84awVX1hdMP+cCKbd7CLQXPSJ3xZ+8VIStP539jNk65vUlH6hoLPRWMdxprcJ8AVIS+526F1aYdGyOUIMI+uHEm3yCZPpspfjLampZy1EaJS8pbcg==',key_name='tempest-keypair-340254793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-pifvb90z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:34:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f50e6a64752e488b9699a8bdda46253c',uuid=3dfe6744-55ec-4294-8fda-5689879ed46b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:2e:d2,bridge_name='br-int',has_traffic_filtering=True,id=7d134985-3e0b-4352-a829-46cc9efcaaa3,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d134985-3e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG os_vif [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:2e:d2,bridge_name='br-int',has_traffic_filtering=True,id=7d134985-3e0b-4352-a829-46cc9efcaaa3,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d134985-3e') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bed0cdb0-9024-55fa-8b1d-50d7106bcde3', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d134985-3e, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d134985-3e, col_values=(('qos', UUID('cbea7d17-fdec-43bb-8860-186899077ab9')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d134985-3e, col_values=(('external_ids', {'iface-id': '7d134985-3e0b-4352-a829-46cc9efcaaa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:2e:d2', 'vm-uuid': '3dfe6744-55ec-4294-8fda-5689879ed46b'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:20 user nova-compute[75000]: INFO os_vif [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:2e:d2,bridge_name='br-int',has_traffic_filtering=True,id=7d134985-3e0b-4352-a829-46cc9efcaaa3,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d134985-3e')
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:34:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No VIF found with MAC fa:16:3e:91:2e:d2, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:34:21 user nova-compute[75000]: DEBUG nova.network.neutron [req-2596bdcb-e5b1-4f78-9698-91a86800601c req-fc94711f-5636-4eac-8199-86de60efed88 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updated VIF entry in instance network info cache for port 7d134985-3e0b-4352-a829-46cc9efcaaa3. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:34:21 user nova-compute[75000]: DEBUG nova.network.neutron [req-2596bdcb-e5b1-4f78-9698-91a86800601c req-fc94711f-5636-4eac-8199-86de60efed88 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updating instance_info_cache with network_info: [{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2596bdcb-e5b1-4f78-9698-91a86800601c req-fc94711f-5636-4eac-8199-86de60efed88 service nova] Releasing lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:34:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-f7aa4b83-1228-4234-a65b-9b5e2776402f req-c84170eb-e48a-4a3e-a723-e8596968a654 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f7aa4b83-1228-4234-a65b-9b5e2776402f req-c84170eb-e48a-4a3e-a723-e8596968a654 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f7aa4b83-1228-4234-a65b-9b5e2776402f req-c84170eb-e48a-4a3e-a723-e8596968a654 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f7aa4b83-1228-4234-a65b-9b5e2776402f req-c84170eb-e48a-4a3e-a723-e8596968a654 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-f7aa4b83-1228-4234-a65b-9b5e2776402f req-c84170eb-e48a-4a3e-a723-e8596968a654 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:22 user nova-compute[75000]: WARNING nova.compute.manager [req-f7aa4b83-1228-4234-a65b-9b5e2776402f req-c84170eb-e48a-4a3e-a723-e8596968a654 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state building and task_state spawning.
Nov 06 22:34:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-c8dcf6ec-9c6e-44ac-8878-309b4a3a9b75 req-a03907d6-6ea2-4df0-a4f5-bb50258f458b service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c8dcf6ec-9c6e-44ac-8878-309b4a3a9b75 req-a03907d6-6ea2-4df0-a4f5-bb50258f458b service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c8dcf6ec-9c6e-44ac-8878-309b4a3a9b75 req-a03907d6-6ea2-4df0-a4f5-bb50258f458b service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c8dcf6ec-9c6e-44ac-8878-309b4a3a9b75 req-a03907d6-6ea2-4df0-a4f5-bb50258f458b service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-c8dcf6ec-9c6e-44ac-8878-309b4a3a9b75 req-a03907d6-6ea2-4df0-a4f5-bb50258f458b service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:24 user nova-compute[75000]: WARNING nova.compute.manager [req-c8dcf6ec-9c6e-44ac-8878-309b4a3a9b75 req-a03907d6-6ea2-4df0-a4f5-bb50258f458b service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state building and task_state spawning.
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:34:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Instance spawned successfully.
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:24 user nova-compute[75000]: INFO nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 06 22:34:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:34:25 user nova-compute[75000]: INFO nova.compute.manager [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Took 7.21 seconds to build instance.
Nov 06 22:34:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0fbb5232-784b-4cb2-8ac9-153535ccc7bd tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.337s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:34:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:34:27 user nova-compute[75000]: INFO nova.compute.claims [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Claim successful on node user
Nov 06 22:34:28 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.806s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:34:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:34:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG nova.policy [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89f94a3ce27c483fabb4a3bcf053f141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121f8a74b2de48a69627c6fc564d023f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:34:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Creating image(s)
Nov 06 22:34:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "/opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "/opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "/opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.363s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk 1073741824" returned: 0 in 0.311s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.519s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.246s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:29 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Successfully created port: 7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Cannot resize image /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Ensure instance console log exists: /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Successfully updated port: 7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "refresh_cache-4632eded-e5f2-4e4d-8558-eb9af2e6aed5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquired lock "refresh_cache-4632eded-e5f2-4e4d-8558-eb9af2e6aed5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-0f00a23b-835b-4498-bb89-79a819419bc2 req-1016d23a-4f3f-4a52-88cc-7a6850a2695b service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received event network-changed-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-0f00a23b-835b-4498-bb89-79a819419bc2 req-1016d23a-4f3f-4a52-88cc-7a6850a2695b service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Refreshing instance network info cache due to event network-changed-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0f00a23b-835b-4498-bb89-79a819419bc2 req-1016d23a-4f3f-4a52-88cc-7a6850a2695b service nova] Acquiring lock "refresh_cache-4632eded-e5f2-4e4d-8558-eb9af2e6aed5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Updating instance_info_cache with network_info: [{"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Releasing lock "refresh_cache-4632eded-e5f2-4e4d-8558-eb9af2e6aed5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Instance network_info: |[{"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0f00a23b-835b-4498-bb89-79a819419bc2 req-1016d23a-4f3f-4a52-88cc-7a6850a2695b service nova] Acquired lock "refresh_cache-4632eded-e5f2-4e4d-8558-eb9af2e6aed5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.network.neutron [req-0f00a23b-835b-4498-bb89-79a819419bc2 req-1016d23a-4f3f-4a52-88cc-7a6850a2695b service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Refreshing network info cache for port 7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Start _get_guest_xml network_info=[{"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:34:31 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:34:31 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1055503720',display_name='tempest-VolumesAdminNegativeTest-server-1055503720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1055503720',id=25,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='121f8a74b2de48a69627c6fc564d023f',ramdisk_id='',reservation_id='r-25xasg7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1947874717',owner_user_name='tempest-VolumesAdminNegativeTest-1947874717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:34:29Z,user_data=None,user_id='89f94a3ce27c483fabb4a3bcf053f141',uuid=4632eded-e5f2-4e4d-8558-eb9af2e6aed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converting VIF {"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:03:83,bridge_name='br-int',has_traffic_filtering=True,id=7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8cd6a6-ea') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.objects.instance [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lazy-loading 'pci_devices' on Instance uuid 4632eded-e5f2-4e4d-8558-eb9af2e6aed5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:34:31 user nova-compute[75000]:   <uuid>4632eded-e5f2-4e4d-8558-eb9af2e6aed5</uuid>
Nov 06 22:34:31 user nova-compute[75000]:   <name>instance-00000019</name>
Nov 06 22:34:31 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:34:31 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:34:31 user nova-compute[75000]:   <metadata>
Nov 06 22:34:31 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:34:31 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:34:31 user nova-compute[75000]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1055503720</nova:name>
Nov 06 22:34:31 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:34:31</nova:creationTime>
Nov 06 22:34:31 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:34:31 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:34:31 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:34:31 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:34:31 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:34:31 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:34:31 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:34:31 user nova-compute[75000]:       <nova:owner>
Nov 06 22:34:31 user nova-compute[75000]:         <nova:user uuid="89f94a3ce27c483fabb4a3bcf053f141">tempest-VolumesAdminNegativeTest-1947874717-project-member</nova:user>
Nov 06 22:34:31 user nova-compute[75000]:         <nova:project uuid="121f8a74b2de48a69627c6fc564d023f">tempest-VolumesAdminNegativeTest-1947874717</nova:project>
Nov 06 22:34:31 user nova-compute[75000]:       </nova:owner>
Nov 06 22:34:31 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:34:31 user nova-compute[75000]:       <nova:ports>
Nov 06 22:34:31 user nova-compute[75000]:         <nova:port uuid="7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba">
Nov 06 22:34:31 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:34:31 user nova-compute[75000]:         </nova:port>
Nov 06 22:34:31 user nova-compute[75000]:       </nova:ports>
Nov 06 22:34:31 user nova-compute[75000]:     </nova:instance>
Nov 06 22:34:31 user nova-compute[75000]:   </metadata>
Nov 06 22:34:31 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:34:31 user nova-compute[75000]:     <system>
Nov 06 22:34:31 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:34:31 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:34:31 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:34:31 user nova-compute[75000]:       <entry name="serial">4632eded-e5f2-4e4d-8558-eb9af2e6aed5</entry>
Nov 06 22:34:31 user nova-compute[75000]:       <entry name="uuid">4632eded-e5f2-4e4d-8558-eb9af2e6aed5</entry>
Nov 06 22:34:31 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:34:31 user nova-compute[75000]:     </system>
Nov 06 22:34:31 user nova-compute[75000]:   </sysinfo>
Nov 06 22:34:31 user nova-compute[75000]:   <os>
Nov 06 22:34:31 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:34:31 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:34:31 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:34:31 user nova-compute[75000]:   </os>
Nov 06 22:34:31 user nova-compute[75000]:   <features>
Nov 06 22:34:31 user nova-compute[75000]:     <acpi/>
Nov 06 22:34:31 user nova-compute[75000]:     <apic/>
Nov 06 22:34:31 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:34:31 user nova-compute[75000]:   </features>
Nov 06 22:34:31 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:34:31 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:34:31 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:34:31 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:34:31 user nova-compute[75000]:   </clock>
Nov 06 22:34:31 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:34:31 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:34:31 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:34:31 user nova-compute[75000]:   </cpu>
Nov 06 22:34:31 user nova-compute[75000]:   <devices>
Nov 06 22:34:31 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:34:31 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:34:31 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk"/>
Nov 06 22:34:31 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:34:31 user nova-compute[75000]:     </disk>
Nov 06 22:34:31 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:34:31 user nova-compute[75000]:       <mac address="fa:16:3e:2e:03:83"/>
Nov 06 22:34:31 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:34:31 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:34:31 user nova-compute[75000]:       <target dev="tap7d8cd6a6-ea"/>
Nov 06 22:34:31 user nova-compute[75000]:     </interface>
Nov 06 22:34:31 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:34:31 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/console.log" append="off"/>
Nov 06 22:34:31 user nova-compute[75000]:     </serial>
Nov 06 22:34:31 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:34:31 user nova-compute[75000]:     <video>
Nov 06 22:34:31 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:34:31 user nova-compute[75000]:     </video>
Nov 06 22:34:31 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:34:31 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:34:31 user nova-compute[75000]:     </rng>
Nov 06 22:34:31 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:34:31 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:34:31 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:34:31 user nova-compute[75000]:     </memballoon>
Nov 06 22:34:31 user nova-compute[75000]:   </devices>
Nov 06 22:34:31 user nova-compute[75000]: </domain>
Nov 06 22:34:31 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1055503720',display_name='tempest-VolumesAdminNegativeTest-server-1055503720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1055503720',id=25,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='121f8a74b2de48a69627c6fc564d023f',ramdisk_id='',reservation_id='r-25xasg7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1947874717',owner_user_name='tempest-VolumesAdminNegativeTest-1947874717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:34:29Z,user_data=None,user_id='89f94a3ce27c483fabb4a3bcf053f141',uuid=4632eded-e5f2-4e4d-8558-eb9af2e6aed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converting VIF {"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:03:83,bridge_name='br-int',has_traffic_filtering=True,id=7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8cd6a6-ea') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG os_vif [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:03:83,bridge_name='br-int',has_traffic_filtering=True,id=7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8cd6a6-ea') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85fdc497-93b8-5034-8538-b6e9dfdf31ff', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d8cd6a6-ea, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d8cd6a6-ea, col_values=(('qos', UUID('d7a56d41-2af9-4eca-aba9-6e69f2a405a5')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d8cd6a6-ea, col_values=(('external_ids', {'iface-id': '7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:03:83', 'vm-uuid': '4632eded-e5f2-4e4d-8558-eb9af2e6aed5'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:31 user nova-compute[75000]: INFO os_vif [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:03:83,bridge_name='br-int',has_traffic_filtering=True,id=7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8cd6a6-ea')
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:34:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] No VIF found with MAC fa:16:3e:2e:03:83, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG nova.network.neutron [req-0f00a23b-835b-4498-bb89-79a819419bc2 req-1016d23a-4f3f-4a52-88cc-7a6850a2695b service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Updated VIF entry in instance network info cache for port 7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG nova.network.neutron [req-0f00a23b-835b-4498-bb89-79a819419bc2 req-1016d23a-4f3f-4a52-88cc-7a6850a2695b service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Updating instance_info_cache with network_info: [{"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0f00a23b-835b-4498-bb89-79a819419bc2 req-1016d23a-4f3f-4a52-88cc-7a6850a2695b service nova] Releasing lock "refresh_cache-4632eded-e5f2-4e4d-8558-eb9af2e6aed5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-a8382459-9637-4e1d-aef2-a29a1ff00ef4 req-b8c63111-23d8-4a32-aa5f-273f3d868985 service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received event network-vif-plugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a8382459-9637-4e1d-aef2-a29a1ff00ef4 req-b8c63111-23d8-4a32-aa5f-273f3d868985 service nova] Acquiring lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a8382459-9637-4e1d-aef2-a29a1ff00ef4 req-b8c63111-23d8-4a32-aa5f-273f3d868985 service nova] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a8382459-9637-4e1d-aef2-a29a1ff00ef4 req-b8c63111-23d8-4a32-aa5f-273f3d868985 service nova] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-a8382459-9637-4e1d-aef2-a29a1ff00ef4 req-b8c63111-23d8-4a32-aa5f-273f3d868985 service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] No waiting events found dispatching network-vif-plugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:34 user nova-compute[75000]: WARNING nova.compute.manager [req-a8382459-9637-4e1d-aef2-a29a1ff00ef4 req-b8c63111-23d8-4a32-aa5f-273f3d868985 service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received unexpected event network-vif-plugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba for instance with vm_state building and task_state spawning.
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-cb50588a-aaeb-42ea-a460-f6d66e706d87 req-f454badd-5b17-487d-95e4-c12ac273189a service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received event network-vif-plugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cb50588a-aaeb-42ea-a460-f6d66e706d87 req-f454badd-5b17-487d-95e4-c12ac273189a service nova] Acquiring lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cb50588a-aaeb-42ea-a460-f6d66e706d87 req-f454badd-5b17-487d-95e4-c12ac273189a service nova] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cb50588a-aaeb-42ea-a460-f6d66e706d87 req-f454badd-5b17-487d-95e4-c12ac273189a service nova] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-cb50588a-aaeb-42ea-a460-f6d66e706d87 req-f454badd-5b17-487d-95e4-c12ac273189a service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] No waiting events found dispatching network-vif-plugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:36 user nova-compute[75000]: WARNING nova.compute.manager [req-cb50588a-aaeb-42ea-a460-f6d66e706d87 req-f454badd-5b17-487d-95e4-c12ac273189a service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received unexpected event network-vif-plugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba for instance with vm_state building and task_state spawning.
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:34:36 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:34:36 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7031MB free_disk=24.656253814697266GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:36 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Instance spawned successfully.
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:34:36 user nova-compute[75000]: INFO nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Took 8.24 seconds to spawn the instance on the hypervisor.
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:36 user nova-compute[75000]: INFO nova.compute.manager [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Took 9.50 seconds to build instance.
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 846bf5e2-230c-419c-be77-982acc036b40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0414d03a-aba0-44df-9cca-257ab81bde61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance e5501afd-b133-451c-b16e-3f03b22cdf66 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0efe3b45-ff8f-48fa-ab0f-822fb64b7272 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 3dfe6744-55ec-4294-8fda-5689879ed46b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 4632eded-e5f2-4e4d-8558-eb9af2e6aed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:34:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7e8b167-834f-4af0-9361-810fb2a3246b tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.632s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:37 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:34:37 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:34:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:34:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.772s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:34:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:34:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:38 user nova-compute[75000]: INFO nova.compute.manager [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Detaching volume 076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:34:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:34:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:34:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:34:38 user nova-compute[75000]: INFO nova.virt.block_device [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Attempting to driver detach volume 076b8cb3-faf6-4575-8f2c-a938527eb6f4 from mountpoint /dev/vdb
Nov 06 22:34:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Attempting to detach device vdb from instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:34:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:34:38 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:34:38 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 22:34:38 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:34:38 user nova-compute[75000]:   <serial>076b8cb3-faf6-4575-8f2c-a938527eb6f4</serial>
Nov 06 22:34:38 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 22:34:38 user nova-compute[75000]: </disk>
Nov 06 22:34:38 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:34:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully detached device vdb from instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 from the persistent domain config.
Nov 06 22:34:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:34:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:34:38 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:34:38 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 22:34:38 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:34:38 user nova-compute[75000]:   <serial>076b8cb3-faf6-4575-8f2c-a938527eb6f4</serial>
Nov 06 22:34:38 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 22:34:38 user nova-compute[75000]: </disk>
Nov 06 22:34:38 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updating instance_info_cache with network_info: [{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:34:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:41 user nova-compute[75000]: INFO nova.compute.manager [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Terminating instance
Nov 06 22:34:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-9f331775-7907-4682-8f26-ba874a6c4ee6 req-49da2dd5-3887-4043-9f6f-cf665b93c790 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-unplugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9f331775-7907-4682-8f26-ba874a6c4ee6 req-49da2dd5-3887-4043-9f6f-cf665b93c790 service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9f331775-7907-4682-8f26-ba874a6c4ee6 req-49da2dd5-3887-4043-9f6f-cf665b93c790 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9f331775-7907-4682-8f26-ba874a6c4ee6 req-49da2dd5-3887-4043-9f6f-cf665b93c790 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-9f331775-7907-4682-8f26-ba874a6c4ee6 req-49da2dd5-3887-4043-9f6f-cf665b93c790 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-unplugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-9f331775-7907-4682-8f26-ba874a6c4ee6 req-49da2dd5-3887-4043-9f6f-cf665b93c790 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-unplugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:34:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Instance destroyed successfully.
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lazy-loading 'resources' on Instance uuid 846bf5e2-230c-419c-be77-982acc036b40 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-410044661',display_name='tempest-ServerActionsTestOtherB-server-410044661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-410044661',id=6,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN127j9rMCzJhcsyMMnA9oMyDSW626YDveQjSPb2IR7mcffJ8blZhWvgtIPRXJ9KDmmNRktgeSU8SDicFRInDOK2YoxINbUZ+i2iHac2q1b7ra/rMkxI3W72lm49ZRgf7w==',key_name='tempest-keypair-1677332467',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:32:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54eb33cd621c4fa78fead18be74916ee',ramdisk_id='',reservation_id='r-nlmmujhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-408033839',owner_user_name='tempest-ServerActionsTestOtherB-408033839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8b116c4cb154ce0a1a80045258cd123',uuid=846bf5e2-230c-419c-be77-982acc036b40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converting VIF {"id": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "address": "fa:16:3e:4f:6d:94", "network": {"id": "5da22bf7-558d-432c-b823-e52ad825dfb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-651500099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54eb33cd621c4fa78fead18be74916ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6cb1907-7c", "ovs_interfaceid": "f6cb1907-7cf4-46fd-9526-9c885c806ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_vif [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6cb1907-7c, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dcebee4-5cbf-4502-b952-9840f46e878b) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:42 user nova-compute[75000]: INFO os_vif [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=f6cb1907-7cf4-46fd-9526-9c885c806ce2,network=Network(5da22bf7-558d-432c-b823-e52ad825dfb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6cb1907-7c')
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wopgvcrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:34:42 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9f9b8b-267b-4428-acef-8febf2e83098]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:34:42 user nova-compute[75000]: No targets found.
Nov 06 22:34:42 user nova-compute[75000]: iSNS:
Nov 06 22:34:42 user nova-compute[75000]: No targets found.
Nov 06 22:34:42 user nova-compute[75000]: STATIC:
Nov 06 22:34:42 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76
Nov 06 22:34:42 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:42 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:42 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:34:42 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:42 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:42 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e
Nov 06 22:34:42 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:42 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:42 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:34:42 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:42 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:42 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320
Nov 06 22:34:42 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:42 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:42 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0
Nov 06 22:34:42 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:42 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:42 user nova-compute[75000]: FIRMWARE:
Nov 06 22:34:42 user nova-compute[75000]: No targets found.
Nov 06 22:34:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:34:42 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:34:42 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d94d65-92b0-4b17-8be6-d3fa7edcaac4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fd6de5-c86d-4486-be87-635c177aac2f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79fc1d39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e'): ({'sdg'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Removing single pathed devices sdg {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb87698-8dee-4191-99f5-901754979941]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c851cd-c8c1-49e1-863d-9474660a4854]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Flushing IO for device /dev/sdg {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b0c49a-73c8-44e4-856d-d98a59d7334f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5e1a03-63fe-4472-9b39-1eb3491dadc0]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] SCSI volumes sdg have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ec3501-0718-4c32-ab9c-420871425487]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[450d4d29-e6c6-4860-a7e2-faa435452113]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260]
Nov 06 22:34:42 user nova-compute[75000]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e, portal: 172.16.0.220,3260] successful.
Nov 06 22:34:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b12a60c7-2bb6-4f35-84f2-a15588cc9e8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24963db-5675-489e-82cc-354e42da613f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] <== disconnect_volume: return (422ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:34:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Deleting instance files /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40_del
Nov 06 22:34:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Deletion of /opt/stack/data/nova/instances/846bf5e2-230c-419c-be77-982acc036b40_del complete
Nov 06 22:34:42 user nova-compute[75000]: INFO nova.compute.manager [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 06 22:34:42 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:34:42 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:44 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Took 1.32 seconds to deallocate network for instance.
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] Acquiring lock "846bf5e2-230c-419c-be77-982acc036b40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] Lock "846bf5e2-230c-419c-be77-982acc036b40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] No waiting events found dispatching network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:44 user nova-compute[75000]: WARNING nova.compute.manager [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received unexpected event network-vif-plugged-f6cb1907-7cf4-46fd-9526-9c885c806ce2 for instance with vm_state active and task_state deleting.
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-changed-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing instance network info cache due to event network-changed-3a779839-57b1-4b62-82c4-7a7cc7eb2abe. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] Acquiring lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] Acquired lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Refreshing network info cache for port 3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updated VIF entry in instance network info cache for port 3a779839-57b1-4b62-82c4-7a7cc7eb2abe. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [{"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] Releasing lock "refresh_cache-e5501afd-b133-451c-b16e-3f03b22cdf66" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-26f76f62-2d71-446a-9d76-457f5f33735e req-5ea59323-50ca-4888-a38d-56f6a3ed24a7 service nova] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Received event network-vif-deleted-f6cb1907-7cf4-46fd-9526-9c885c806ce2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:44 user nova-compute[75000]: INFO nova.compute.manager [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Terminating instance
Nov 06 22:34:44 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:34:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG nova.compute.manager [req-98b0569f-1ae7-4430-a00a-1aa810e44a2e req-8cb2aeb9-15fd-4f8a-bea2-f6717e864625 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-98b0569f-1ae7-4430-a00a-1aa810e44a2e req-8cb2aeb9-15fd-4f8a-bea2-f6717e864625 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-98b0569f-1ae7-4430-a00a-1aa810e44a2e req-8cb2aeb9-15fd-4f8a-bea2-f6717e864625 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-98b0569f-1ae7-4430-a00a-1aa810e44a2e req-8cb2aeb9-15fd-4f8a-bea2-f6717e864625 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG nova.compute.manager [req-98b0569f-1ae7-4430-a00a-1aa810e44a2e req-8cb2aeb9-15fd-4f8a-bea2-f6717e864625 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-unplugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG nova.compute.manager [req-98b0569f-1ae7-4430-a00a-1aa810e44a2e req-8cb2aeb9-15fd-4f8a-bea2-f6717e864625 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: INFO nova.compute.manager [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] [instance: 846bf5e2-230c-419c-be77-982acc036b40] Took 1.53 seconds to detach 1 volumes for instance.
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-unplugged-99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-99865ff8-659c-4199-b3c9-371b5481c5ac for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-99865ff8-659c-4199-b3c9-371b5481c5ac {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:46 user nova-compute[75000]: WARNING nova.compute.manager [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-99865ff8-659c-4199-b3c9-371b5481c5ac for instance with vm_state active and task_state deleting.
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-unplugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-5976043d-d515-4251-b88b-656d935230c2 req-a82ae44c-cce4-4d53-ac57-07f10821d071 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:34:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.049s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:46 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Deleted allocations for instance 846bf5e2-230c-419c-be77-982acc036b40
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a984dc76-22ab-41b7-9698-39d5cacc0db1 tempest-ServerActionsTestOtherB-408033839 tempest-ServerActionsTestOtherB-408033839-project-member] Lock "846bf5e2-230c-419c-be77-982acc036b40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.686s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:47 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Instance destroyed successfully.
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lazy-loading 'resources' on Instance uuid e5501afd-b133-451c-b16e-3f03b22cdf66 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:4e:8d,bridge_name='br-int',has_traffic_filtering=True,id=3a779839-57b1-4b62-82c4-7a7cc7eb2abe,network=Network(5d67b529-e9c2-4269-b640-70e899501ed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a779839-57') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:4e:8d,bridge_name='br-int',has_traffic_filtering=True,id=3a779839-57b1-4b62-82c4-7a7cc7eb2abe,network=Network(5d67b529-e9c2-4269-b640-70e899501ed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a779839-57') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a779839-57, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43a00341-b7b9-4cb3-b596-5ea98687d0de) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: INFO os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:4e:8d,bridge_name='br-int',has_traffic_filtering=True,id=3a779839-57b1-4b62-82c4-7a7cc7eb2abe,network=Network(5d67b529-e9c2-4269-b640-70e899501ed7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a779839-57')
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=54546932-5914-428a-bbdc-887e3b128f96,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54546932-59') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=54546932-5914-428a-bbdc-887e3b128f96,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54546932-59') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54546932-59, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02ae34bb-1b7f-4681-871b-327b3c2c7a73) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: INFO os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:3f:3b,bridge_name='br-int',has_traffic_filtering=True,id=54546932-5914-428a-bbdc-887e3b128f96,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap54546932-59')
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:0e,bridge_name='br-int',has_traffic_filtering=True,id=99865ff8-659c-4199-b3c9-371b5481c5ac,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99865ff8-65') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:0e,bridge_name='br-int',has_traffic_filtering=True,id=99865ff8-659c-4199-b3c9-371b5481c5ac,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99865ff8-65') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99865ff8-65, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:47 user nova-compute[75000]: WARNING nova.compute.manager [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-3a779839-57b1-4b62-82c4-7a7cc7eb2abe for instance with vm_state active and task_state deleting.
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-unplugged-54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-54546932-5914-428a-bbdc-887e3b128f96 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-54546932-5914-428a-bbdc-887e3b128f96 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:47 user nova-compute[75000]: WARNING nova.compute.manager [req-719132b0-c3a0-4703-b1f7-72315cb6a314 req-85f55351-cd2c-4d9d-a076-181e464d7f77 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-54546932-5914-428a-bbdc-887e3b128f96 for instance with vm_state active and task_state deleting.
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3231e170-acbb-4e43-bc89-61e5b40beb75) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: INFO os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:6c:0e,bridge_name='br-int',has_traffic_filtering=True,id=99865ff8-659c-4199-b3c9-371b5481c5ac,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99865ff8-65')
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "address": "fa:16:3e:7e:47:f7", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a27d08a-10", "ovs_interfaceid": "7a27d08a-1050-40f1-9af8-f05e3b4a39c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7a27d08a-1050-40f1-9af8-f05e3b4a39c4,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a27d08a-10') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7a27d08a-1050-40f1-9af8-f05e3b4a39c4,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a27d08a-10') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a27d08a-10, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6235d4e-1b5e-4a0c-bac1-ced5f5d79eed) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: INFO os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7a27d08a-1050-40f1-9af8-f05e3b4a39c4,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a27d08a-10')
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:40,bridge_name='br-int',has_traffic_filtering=True,id=fa4338d3-8249-4aab-8e23-8d254737e00b,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4338d3-82') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:40,bridge_name='br-int',has_traffic_filtering=True,id=fa4338d3-8249-4aab-8e23-8d254737e00b,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4338d3-82') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa4338d3-82, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=076f54fe-48ac-4e59-a333-3b3ef832153f) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: INFO os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e4:40,bridge_name='br-int',has_traffic_filtering=True,id=fa4338d3-8249-4aab-8e23-8d254737e00b,network=Network(e0d30640-8a0a-49e8-a844-64921ee2c500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4338d3-82')
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5a:55,bridge_name='br-int',has_traffic_filtering=True,id=03a6d148-7ee7-4fff-a49e-4fa1d6736ec4,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a6d148-7e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5a:55,bridge_name='br-int',has_traffic_filtering=True,id=03a6d148-7ee7-4fff-a49e-4fa1d6736ec4,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a6d148-7e') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03a6d148-7e, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0e6ec55-d220-4f9e-883c-a3948b197601) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:34:47 user nova-compute[75000]: INFO os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:5a:55,bridge_name='br-int',has_traffic_filtering=True,id=03a6d148-7ee7-4fff-a49e-4fa1d6736ec4,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a6d148-7e')
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T22:31:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1106496954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1106496954',id=19,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvqusJfl1jl02G4KeQecs9VahPIJBR+xZmsnrEQmW2kxw2sSboqrDSeucfycE6qBoo5j1RoOxwwhmg6CVuI7nSBPnc87eRAPUdoofpblBNCkb+ViCJm8AydiSwp8K9w+g==',key_name='tempest-keypair-1229661709',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df531ecc8a244028bad3f3cbd63eaf57',ramdisk_id='',reservation_id='r-5oiaj5q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2012630351',owner_user_name='tempest-TaggedBootDevicesTest-2012630351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbceb6180510486c8f3bd60985e0b5a7',uuid=e5501afd-b133-451c-b16e-3f03b22cdf66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converting VIF {"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:52,bridge_name='br-int',has_traffic_filtering=True,id=e13357c8-b09a-41d6-9ccb-36a02e3ce2e1,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13357c8-b0') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:52,bridge_name='br-int',has_traffic_filtering=True,id=e13357c8-b09a-41d6-9ccb-36a02e3ce2e1,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13357c8-b0') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape13357c8-b0, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c97caa10-af40-4404-9d5a-d746dc031562) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:47 user nova-compute[75000]: INFO os_vif [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f7:52,bridge_name='br-int',has_traffic_filtering=True,id=e13357c8-b09a-41d6-9ccb-36a02e3ce2e1,network=Network(07792da8-b8f5-4599-a49e-dde210838ecc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13357c8-b0')
Nov 06 22:34:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkhiJDqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:34:47 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c9f81b-22f7-4f83-abf9-f49a006ba0f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:34:47 user nova-compute[75000]: No targets found.
Nov 06 22:34:47 user nova-compute[75000]: iSNS:
Nov 06 22:34:47 user nova-compute[75000]: No targets found.
Nov 06 22:34:47 user nova-compute[75000]: STATIC:
Nov 06 22:34:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76
Nov 06 22:34:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:34:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:34:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320
Nov 06 22:34:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0
Nov 06 22:34:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:47 user nova-compute[75000]: FIRMWARE:
Nov 06 22:34:47 user nova-compute[75000]: No targets found.
Nov 06 22:34:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:34:47 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:34:47 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fd533b-9301-4dcf-9e20-741631aad881]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f11bff0-b40b-4890-8367-e0dc5ac4cda1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7a093d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0'): ({'sdh'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Removing single pathed devices sdh {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c900a80-6fff-43f6-a869-80441776151c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5647042-3700-4ff3-a967-15c534dc7b01]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Flushing IO for device /dev/sdh {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a8ec71-3cf1-49ac-a5fc-30ea85782f93]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f4d871-4cf9-477f-8f79-ad4c703f2392]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] SCSI volumes sdh have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f3c831-ba8c-46d5-9f20-b1832398a3e5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca9d0e2-eaea-4c4b-bfd0-93748d0b4930]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0, portal: 172.16.0.220,3260]
Nov 06 22:34:48 user nova-compute[75000]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0, portal: 172.16.0.220,3260] successful.
Nov 06 22:34:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51516dc7-babc-4eda-866e-0245b93bdec0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f6fef-fefb-4cd6-babd-bcf130b37cc2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] <== disconnect_volume: return (345ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCNPFvpc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:34:48 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae69ed5-5344-4075-b38c-31c43fc6476c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:34:48 user nova-compute[75000]: No targets found.
Nov 06 22:34:48 user nova-compute[75000]: iSNS:
Nov 06 22:34:48 user nova-compute[75000]: No targets found.
Nov 06 22:34:48 user nova-compute[75000]: STATIC:
Nov 06 22:34:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76
Nov 06 22:34:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:34:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:34:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320
Nov 06 22:34:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:48 user nova-compute[75000]: FIRMWARE:
Nov 06 22:34:48 user nova-compute[75000]: No targets found.
Nov 06 22:34:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:34:48 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:34:48 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca653e8f-6e0c-44be-80ea-506436b503f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f848b0b-aba3-493b-886e-c44d2b8b827a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7a093d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76'): ({'sdi'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Removing single pathed devices sdi {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5b1bc6-e0ed-4c54-bcd0-a713dbc7bca8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8e0cea-11f5-4dd8-b71e-23189ca3fe7e]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Flushing IO for device /dev/sdi {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b117a76e-f75b-469a-b3ed-efb1235903cc]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:48 user nova-compute[75000]: WARNING nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 for instance with vm_state active and task_state deleting.
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-unplugged-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-fa4338d3-8249-4aab-8e23-8d254737e00b for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:48 user nova-compute[75000]: WARNING nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-fa4338d3-8249-4aab-8e23-8d254737e00b for instance with vm_state active and task_state deleting.
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-unplugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:48 user nova-compute[75000]: WARNING nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 for instance with vm_state active and task_state deleting.
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-unplugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-unplugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-plugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Acquiring lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] No waiting events found dispatching network-vif-plugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:34:48 user nova-compute[75000]: WARNING nova.compute.manager [req-1d391bbc-ece8-40e0-b20d-4434f3f9d653 req-7040452f-1837-4d45-a7ed-01e7f4f886e5 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received unexpected event network-vif-plugged-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 for instance with vm_state active and task_state deleting.
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e641da4-e278-40d8-988f-c1027c5e8108]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] SCSI volumes sdi have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7546da1-2b90-451d-8544-840e72f817c6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeef5ad9-7eb4-4969-ab43-ae3d37ca74a9]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76, portal: 172.16.0.220,3260]
Nov 06 22:34:48 user nova-compute[75000]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76, portal: 172.16.0.220,3260] successful.
Nov 06 22:34:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dbd0369-23b5-4036-be4a-fcf6ba4c9b76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8846ceb-412e-49d2-a398-33642a2555dc]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] <== disconnect_volume: return (356ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjeoGugH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:34:48 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b5ed74-2c56-4fcc-b987-db5c4a2aaa9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:34:48 user nova-compute[75000]: No targets found.
Nov 06 22:34:48 user nova-compute[75000]: iSNS:
Nov 06 22:34:48 user nova-compute[75000]: No targets found.
Nov 06 22:34:48 user nova-compute[75000]: STATIC:
Nov 06 22:34:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:34:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:34:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320
Nov 06 22:34:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:48 user nova-compute[75000]: FIRMWARE:
Nov 06 22:34:48 user nova-compute[75000]: No targets found.
Nov 06 22:34:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:34:48 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:34:48 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c325d497-ed1a-4a66-a91d-9cedc6398f70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e5da71-7efa-4991-8b3d-b6ec264ba5c2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7a093d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320'): ({'sdj'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Removing single pathed devices sdj {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab2cc1a-10e9-49db-b574-487989b2af44]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dfa236-03d9-4c7c-9889-9bc53464a151]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Flushing IO for device /dev/sdj {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d3193c-3eb2-4da7-a62e-e44e6e1e4963]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.048s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8e836-8deb-454f-a71b-ffea6caeaada]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] SCSI volumes sdj have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c640a5-30f3-47bb-9c2c-671209a11b8c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9322cd-d741-473f-af7c-fd579406a558]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320, portal: 172.16.0.220,3260]
Nov 06 22:34:48 user nova-compute[75000]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320, portal: 172.16.0.220,3260] successful.
Nov 06 22:34:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff7647fd-5314-4376-b166-994b9ca3e320 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b156f593-f7e1-488c-a7ef-28c2dabd1814]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] <== disconnect_volume: return (340ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:34:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:34:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Deleting instance files /opt/stack/data/nova/instances/e5501afd-b133-451c-b16e-3f03b22cdf66_del
Nov 06 22:34:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Deletion of /opt/stack/data/nova/instances/e5501afd-b133-451c-b16e-3f03b22cdf66_del complete
Nov 06 22:34:49 user nova-compute[75000]: INFO nova.compute.manager [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Took 4.08 seconds to destroy the instance on the hypervisor.
Nov 06 22:34:49 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:34:49 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:34:49 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:34:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-0346da59-ca4d-43b3-9e3e-b4d35be68375 req-81caca1e-8e4a-4702-852d-16f03e54968c service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-deleted-7a27d08a-1050-40f1-9af8-f05e3b4a39c4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:51 user nova-compute[75000]: INFO nova.compute.manager [req-0346da59-ca4d-43b3-9e3e-b4d35be68375 req-81caca1e-8e4a-4702-852d-16f03e54968c service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Neutron deleted interface 7a27d08a-1050-40f1-9af8-f05e3b4a39c4; detaching it from the instance and deleting it from the info cache
Nov 06 22:34:51 user nova-compute[75000]: DEBUG nova.network.neutron [req-0346da59-ca4d-43b3-9e3e-b4d35be68375 req-81caca1e-8e4a-4702-852d-16f03e54968c service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [{"id": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "address": "fa:16:3e:86:4e:8d", "network": {"id": "5d67b529-e9c2-4269-b640-70e899501ed7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2014088062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a779839-57", "ovs_interfaceid": "3a779839-57b1-4b62-82c4-7a7cc7eb2abe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "54546932-5914-428a-bbdc-887e3b128f96", "address": "fa:16:3e:09:3f:3b", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54546932-59", "ovs_interfaceid": "54546932-5914-428a-bbdc-887e3b128f96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "99865ff8-659c-4199-b3c9-371b5481c5ac", "address": "fa:16:3e:25:6c:0e", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99865ff8-65", "ovs_interfaceid": "99865ff8-659c-4199-b3c9-371b5481c5ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa4338d3-8249-4aab-8e23-8d254737e00b", "address": "fa:16:3e:b2:e4:40", "network": {"id": "e0d30640-8a0a-49e8-a844-64921ee2c500", "bridge": "br-int", "label": "tempest-device-tagging-net1-1442316240", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4338d3-82", "ovs_interfaceid": "fa4338d3-8249-4aab-8e23-8d254737e00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "address": "fa:16:3e:6f:5a:55", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a6d148-7e", "ovs_interfaceid": "03a6d148-7ee7-4fff-a49e-4fa1d6736ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "address": "fa:16:3e:cc:f7:52", "network": {"id": "07792da8-b8f5-4599-a49e-dde210838ecc", "bridge": "br-int", "label": "tempest-device-tagging-net2-178578444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df531ecc8a244028bad3f3cbd63eaf57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13357c8-b0", "ovs_interfaceid": "e13357c8-b09a-41d6-9ccb-36a02e3ce2e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-0346da59-ca4d-43b3-9e3e-b4d35be68375 req-81caca1e-8e4a-4702-852d-16f03e54968c service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Detach interface failed, port_id=7a27d08a-1050-40f1-9af8-f05e3b4a39c4, reason: Instance e5501afd-b133-451c-b16e-3f03b22cdf66 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:34:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:53 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:53 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Took 4.05 seconds to deallocate network for instance.
Nov 06 22:34:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-22d94b64-5cc1-490b-908c-8444b99a9310 req-e1b663fa-bc46-4fb7-9abf-cafd4b1fa241 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-deleted-e13357c8-b09a-41d6-9ccb-36a02e3ce2e1 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-22d94b64-5cc1-490b-908c-8444b99a9310 req-e1b663fa-bc46-4fb7-9abf-cafd4b1fa241 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-deleted-03a6d148-7ee7-4fff-a49e-4fa1d6736ec4 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-22d94b64-5cc1-490b-908c-8444b99a9310 req-e1b663fa-bc46-4fb7-9abf-cafd4b1fa241 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-deleted-fa4338d3-8249-4aab-8e23-8d254737e00b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-22d94b64-5cc1-490b-908c-8444b99a9310 req-e1b663fa-bc46-4fb7-9abf-cafd4b1fa241 service nova] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Received event network-vif-deleted-3a779839-57b1-4b62-82c4-7a7cc7eb2abe {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:55 user nova-compute[75000]: INFO nova.compute.manager [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] [instance: e5501afd-b133-451c-b16e-3f03b22cdf66] Took 2.70 seconds to detach 3 volumes for instance.
Nov 06 22:34:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:34:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:34:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:56 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:34:56 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:34:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:56 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Deleted allocations for instance e5501afd-b133-451c-b16e-3f03b22cdf66
Nov 06 22:34:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0e63fa21-ecf3-4ef6-b185-594de1c2f9db tempest-TaggedBootDevicesTest-2012630351 tempest-TaggedBootDevicesTest-2012630351-project-member] Lock "e5501afd-b133-451c-b16e-3f03b22cdf66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.492s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:34:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-e8f8a45c-ace4-469d-b676-feb70c1488f4 req-60d7b12a-4984-4850-8e14-dccbc0f9fa90 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-changed-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:34:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-e8f8a45c-ace4-469d-b676-feb70c1488f4 req-60d7b12a-4984-4850-8e14-dccbc0f9fa90 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Refreshing instance network info cache due to event network-changed-78f02e5b-8e34-4d73-907b-c49095cc8147. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:34:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8f8a45c-ace4-469d-b676-feb70c1488f4 req-60d7b12a-4984-4850-8e14-dccbc0f9fa90 service nova] Acquiring lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:34:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8f8a45c-ace4-469d-b676-feb70c1488f4 req-60d7b12a-4984-4850-8e14-dccbc0f9fa90 service nova] Acquired lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:34:56 user nova-compute[75000]: DEBUG nova.network.neutron [req-e8f8a45c-ace4-469d-b676-feb70c1488f4 req-60d7b12a-4984-4850-8e14-dccbc0f9fa90 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Refreshing network info cache for port 78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:34:57 user nova-compute[75000]: DEBUG nova.network.neutron [req-e8f8a45c-ace4-469d-b676-feb70c1488f4 req-60d7b12a-4984-4850-8e14-dccbc0f9fa90 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updated VIF entry in instance network info cache for port 78f02e5b-8e34-4d73-907b-c49095cc8147. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:34:57 user nova-compute[75000]: DEBUG nova.network.neutron [req-e8f8a45c-ace4-469d-b676-feb70c1488f4 req-60d7b12a-4984-4850-8e14-dccbc0f9fa90 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updating instance_info_cache with network_info: [{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:34:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8f8a45c-ace4-469d-b676-feb70c1488f4 req-60d7b12a-4984-4850-8e14-dccbc0f9fa90 service nova] Releasing lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:34:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:34:59 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 is timed out.
Nov 06 22:34:59 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully detached device vdb from instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 from the live domain config.
Nov 06 22:34:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFOKHcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:34:59 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea657ee5-2a16-46a2-90db-d5cfe247d6fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:34:59 user nova-compute[75000]: No targets found.
Nov 06 22:34:59 user nova-compute[75000]: iSNS:
Nov 06 22:34:59 user nova-compute[75000]: No targets found.
Nov 06 22:34:59 user nova-compute[75000]: STATIC:
Nov 06 22:34:59 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4
Nov 06 22:34:59 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:59 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:59 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:34:59 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:34:59 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:34:59 user nova-compute[75000]: FIRMWARE:
Nov 06 22:34:59 user nova-compute[75000]: No targets found.
Nov 06 22:34:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:34:59 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:34:59 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc9f387-a59f-411f-8ac9-3768a637bd8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa6b7f-d894-4a7e-a441-ba45543f6952]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:59 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 (non-flash)
Nov 06 22:34:59 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:34:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc278a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4'): ({'sdd'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Removing single pathed devices sdd {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5846d05-eb9c-4538-aeff-c2343790cfca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdde522-d8d2-43e1-b33e-65958c3b7002]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flushing IO for device /dev/sdd {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[be88ab18-5abc-41bb-8d88-f00a04043969]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e2ac4e-9def-478c-94a7-71e8d3457530]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[70481840-8c25-46b9-963a-5d5c6cccbf34]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6555b368-a736-4447-ba96-60274ec3b5fe]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260]
Nov 06 22:34:59 user nova-compute[75000]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4, portal: 172.16.0.220,3260] successful.
Nov 06 22:34:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:076b8cb3-faf6-4575-8f2c-a938527eb6f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa3fb8f-ee8d-453d-9b89-5d855fa4124c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== disconnect_volume: return (331ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:34:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:02 user nova-compute[75000]: DEBUG nova.objects.instance [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:03 user nova-compute[75000]: INFO nova.compute.manager [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Attaching volume e80316b8-80c9-4a48-824d-b1c11fa1e633 to /dev/vdb
Nov 06 22:35:03 user nova-compute[75000]: DEBUG nova.objects.instance [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'flavor' on Instance uuid 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG os_brick.utils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3a84bc9b-f747-4922-9c60-1351a3cac9d8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.788s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff868014-4d43-49f1-b28e-6989a6601932]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f972b8ba-4d3a-40bc-9c99-c3bec789a942]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0517fd8-f78f-4237-803c-2a5fab4c4ae9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b0b7c4-c580-4bca-b389-a086e63aebed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:35:03 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:35:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bdb8e6-4199-4d1d-a57e-d3b04683bf9d]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG os_brick.utils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updating existing volume attachment record: 182b29f4-63a1-47f2-951f-ec3a47059b79 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:35:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:13 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:35:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:35:13 user nova-compute[75000]: INFO nova.compute.claims [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Claim successful on node user
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:35:14 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.policy [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48d79d2923844f5ab8fab301ee9293ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130a3805426f42b69b24c50d02395db2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:35:14 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Creating image(s)
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "/opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "/opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk 1073741824" returned: 0 in 0.061s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:14 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Successfully created port: 8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Cannot resize image /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Ensure instance console log exists: /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Successfully updated port: 8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "refresh_cache-0bd209e9-b6c8-4663-a443-77d251b3d802" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquired lock "refresh_cache-0bd209e9-b6c8-4663-a443-77d251b3d802" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-9efb2f6f-44e7-4455-b29c-3d097d25e1ee req-e30c925d-2065-464d-9e99-ba82f9dac759 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received event network-changed-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-9efb2f6f-44e7-4455-b29c-3d097d25e1ee req-e30c925d-2065-464d-9e99-ba82f9dac759 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Refreshing instance network info cache due to event network-changed-8cdb01ae-906f-4ff4-bc2c-2511cce726de. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9efb2f6f-44e7-4455-b29c-3d097d25e1ee req-e30c925d-2065-464d-9e99-ba82f9dac759 service nova] Acquiring lock "refresh_cache-0bd209e9-b6c8-4663-a443-77d251b3d802" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Updating instance_info_cache with network_info: [{"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Releasing lock "refresh_cache-0bd209e9-b6c8-4663-a443-77d251b3d802" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Instance network_info: |[{"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9efb2f6f-44e7-4455-b29c-3d097d25e1ee req-e30c925d-2065-464d-9e99-ba82f9dac759 service nova] Acquired lock "refresh_cache-0bd209e9-b6c8-4663-a443-77d251b3d802" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.network.neutron [req-9efb2f6f-44e7-4455-b29c-3d097d25e1ee req-e30c925d-2065-464d-9e99-ba82f9dac759 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Refreshing network info cache for port 8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Start _get_guest_xml network_info=[{"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:35:15 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:35:15 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:35:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:35:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-682901431',display_name='tempest-TestServerVolumeAttachmentScenario-server-682901431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-682901431',id=26,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1h8ZSOrkcpBbuUxvaOxk+QpM2E73Xu2yUhvNuMGZIElUDiZElxguXwDPpUgr3s9LwFAPWR09OnR8euephu9CUVoM/PS01/ess/ATXt0wK1co8MB/cF3aL15oarev009A==',key_name='tempest-keypair-410361526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='130a3805426f42b69b24c50d02395db2',ramdisk_id='',reservation_id='r-4483v1jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1946604441',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1946604441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:35:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48d79d2923844f5ab8fab301ee9293ef',uuid=0bd209e9-b6c8-4663-a443-77d251b3d802,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Converting VIF {"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:7c,bridge_name='br-int',has_traffic_filtering=True,id=8cdb01ae-906f-4ff4-bc2c-2511cce726de,network=Network(fcf66f23-2c6d-4313-ac6f-2905af9164c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdb01ae-90') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.objects.instance [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:35:16 user nova-compute[75000]:   <uuid>0bd209e9-b6c8-4663-a443-77d251b3d802</uuid>
Nov 06 22:35:16 user nova-compute[75000]:   <name>instance-0000001a</name>
Nov 06 22:35:16 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:35:16 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:35:16 user nova-compute[75000]:   <metadata>
Nov 06 22:35:16 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:35:16 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:35:16 user nova-compute[75000]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-682901431</nova:name>
Nov 06 22:35:16 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:35:15</nova:creationTime>
Nov 06 22:35:16 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:35:16 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:35:16 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:35:16 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:35:16 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:35:16 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:35:16 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:35:16 user nova-compute[75000]:       <nova:owner>
Nov 06 22:35:16 user nova-compute[75000]:         <nova:user uuid="48d79d2923844f5ab8fab301ee9293ef">tempest-TestServerVolumeAttachmentScenario-1946604441-project-member</nova:user>
Nov 06 22:35:16 user nova-compute[75000]:         <nova:project uuid="130a3805426f42b69b24c50d02395db2">tempest-TestServerVolumeAttachmentScenario-1946604441</nova:project>
Nov 06 22:35:16 user nova-compute[75000]:       </nova:owner>
Nov 06 22:35:16 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:35:16 user nova-compute[75000]:       <nova:ports>
Nov 06 22:35:16 user nova-compute[75000]:         <nova:port uuid="8cdb01ae-906f-4ff4-bc2c-2511cce726de">
Nov 06 22:35:16 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 22:35:16 user nova-compute[75000]:         </nova:port>
Nov 06 22:35:16 user nova-compute[75000]:       </nova:ports>
Nov 06 22:35:16 user nova-compute[75000]:     </nova:instance>
Nov 06 22:35:16 user nova-compute[75000]:   </metadata>
Nov 06 22:35:16 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:35:16 user nova-compute[75000]:     <system>
Nov 06 22:35:16 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:35:16 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:35:16 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:35:16 user nova-compute[75000]:       <entry name="serial">0bd209e9-b6c8-4663-a443-77d251b3d802</entry>
Nov 06 22:35:16 user nova-compute[75000]:       <entry name="uuid">0bd209e9-b6c8-4663-a443-77d251b3d802</entry>
Nov 06 22:35:16 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:35:16 user nova-compute[75000]:     </system>
Nov 06 22:35:16 user nova-compute[75000]:   </sysinfo>
Nov 06 22:35:16 user nova-compute[75000]:   <os>
Nov 06 22:35:16 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:35:16 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:35:16 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:35:16 user nova-compute[75000]:   </os>
Nov 06 22:35:16 user nova-compute[75000]:   <features>
Nov 06 22:35:16 user nova-compute[75000]:     <acpi/>
Nov 06 22:35:16 user nova-compute[75000]:     <apic/>
Nov 06 22:35:16 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:35:16 user nova-compute[75000]:   </features>
Nov 06 22:35:16 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:35:16 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:35:16 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:35:16 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:35:16 user nova-compute[75000]:   </clock>
Nov 06 22:35:16 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:35:16 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:35:16 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:35:16 user nova-compute[75000]:   </cpu>
Nov 06 22:35:16 user nova-compute[75000]:   <devices>
Nov 06 22:35:16 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:35:16 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:35:16 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk"/>
Nov 06 22:35:16 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:35:16 user nova-compute[75000]:     </disk>
Nov 06 22:35:16 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:35:16 user nova-compute[75000]:       <mac address="fa:16:3e:45:38:7c"/>
Nov 06 22:35:16 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:35:16 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:35:16 user nova-compute[75000]:       <target dev="tap8cdb01ae-90"/>
Nov 06 22:35:16 user nova-compute[75000]:     </interface>
Nov 06 22:35:16 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:35:16 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/console.log" append="off"/>
Nov 06 22:35:16 user nova-compute[75000]:     </serial>
Nov 06 22:35:16 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:35:16 user nova-compute[75000]:     <video>
Nov 06 22:35:16 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:35:16 user nova-compute[75000]:     </video>
Nov 06 22:35:16 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:35:16 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:35:16 user nova-compute[75000]:     </rng>
Nov 06 22:35:16 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:35:16 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:35:16 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:35:16 user nova-compute[75000]:     </memballoon>
Nov 06 22:35:16 user nova-compute[75000]:   </devices>
Nov 06 22:35:16 user nova-compute[75000]: </domain>
Nov 06 22:35:16 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:35:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-682901431',display_name='tempest-TestServerVolumeAttachmentScenario-server-682901431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-682901431',id=26,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1h8ZSOrkcpBbuUxvaOxk+QpM2E73Xu2yUhvNuMGZIElUDiZElxguXwDPpUgr3s9LwFAPWR09OnR8euephu9CUVoM/PS01/ess/ATXt0wK1co8MB/cF3aL15oarev009A==',key_name='tempest-keypair-410361526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='130a3805426f42b69b24c50d02395db2',ramdisk_id='',reservation_id='r-4483v1jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1946604441',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1946604441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:35:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48d79d2923844f5ab8fab301ee9293ef',uuid=0bd209e9-b6c8-4663-a443-77d251b3d802,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Converting VIF {"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:7c,bridge_name='br-int',has_traffic_filtering=True,id=8cdb01ae-906f-4ff4-bc2c-2511cce726de,network=Network(fcf66f23-2c6d-4313-ac6f-2905af9164c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdb01ae-90') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG os_vif [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:7c,bridge_name='br-int',has_traffic_filtering=True,id=8cdb01ae-906f-4ff4-bc2c-2511cce726de,network=Network(fcf66f23-2c6d-4313-ac6f-2905af9164c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdb01ae-90') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5d5dc3e-f40a-5310-a0d5-bbac09d6b39d', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cdb01ae-90, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cdb01ae-90, col_values=(('qos', UUID('c02c26e7-60ea-4233-a327-d71319aa4718')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cdb01ae-90, col_values=(('external_ids', {'iface-id': '8cdb01ae-906f-4ff4-bc2c-2511cce726de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:38:7c', 'vm-uuid': '0bd209e9-b6c8-4663-a443-77d251b3d802'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:16 user nova-compute[75000]: INFO os_vif [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:7c,bridge_name='br-int',has_traffic_filtering=True,id=8cdb01ae-906f-4ff4-bc2c-2511cce726de,network=Network(fcf66f23-2c6d-4313-ac6f-2905af9164c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdb01ae-90')
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] No VIF found with MAC fa:16:3e:45:38:7c, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-9efb2f6f-44e7-4455-b29c-3d097d25e1ee req-e30c925d-2065-464d-9e99-ba82f9dac759 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Updated VIF entry in instance network info cache for port 8cdb01ae-906f-4ff4-bc2c-2511cce726de. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-9efb2f6f-44e7-4455-b29c-3d097d25e1ee req-e30c925d-2065-464d-9e99-ba82f9dac759 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Updating instance_info_cache with network_info: [{"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:35:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9efb2f6f-44e7-4455-b29c-3d097d25e1ee req-e30c925d-2065-464d-9e99-ba82f9dac759 service nova] Releasing lock "refresh_cache-0bd209e9-b6c8-4663-a443-77d251b3d802" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:35:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-e8c0caae-4bc5-4455-9d03-673a92ae93a6 req-3db4b283-4f8d-414b-9fac-10151206185c service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received event network-vif-plugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8c0caae-4bc5-4455-9d03-673a92ae93a6 req-3db4b283-4f8d-414b-9fac-10151206185c service nova] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8c0caae-4bc5-4455-9d03-673a92ae93a6 req-3db4b283-4f8d-414b-9fac-10151206185c service nova] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8c0caae-4bc5-4455-9d03-673a92ae93a6 req-3db4b283-4f8d-414b-9fac-10151206185c service nova] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-e8c0caae-4bc5-4455-9d03-673a92ae93a6 req-3db4b283-4f8d-414b-9fac-10151206185c service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] No waiting events found dispatching network-vif-plugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:35:17 user nova-compute[75000]: WARNING nova.compute.manager [req-e8c0caae-4bc5-4455-9d03-673a92ae93a6 req-3db4b283-4f8d-414b-9fac-10151206185c service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received unexpected event network-vif-plugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de for instance with vm_state building and task_state spawning.
Nov 06 22:35:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:35:19 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Instance spawned successfully.
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-f01b9e5e-f424-4f78-ba3a-a25c35836b2c req-fa3c7a48-9b39-4900-aad9-e6f6a687f249 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received event network-vif-plugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f01b9e5e-f424-4f78-ba3a-a25c35836b2c req-fa3c7a48-9b39-4900-aad9-e6f6a687f249 service nova] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f01b9e5e-f424-4f78-ba3a-a25c35836b2c req-fa3c7a48-9b39-4900-aad9-e6f6a687f249 service nova] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f01b9e5e-f424-4f78-ba3a-a25c35836b2c req-fa3c7a48-9b39-4900-aad9-e6f6a687f249 service nova] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-f01b9e5e-f424-4f78-ba3a-a25c35836b2c req-fa3c7a48-9b39-4900-aad9-e6f6a687f249 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] No waiting events found dispatching network-vif-plugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:35:19 user nova-compute[75000]: WARNING nova.compute.manager [req-f01b9e5e-f424-4f78-ba3a-a25c35836b2c req-fa3c7a48-9b39-4900-aad9-e6f6a687f249 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received unexpected event network-vif-plugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de for instance with vm_state building and task_state spawning.
Nov 06 22:35:19 user nova-compute[75000]: INFO nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 06 22:35:19 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:35:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:19 user nova-compute[75000]: INFO nova.compute.manager [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Took 6.40 seconds to build instance.
Nov 06 22:35:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2a7a3c1b-ef09-4249-9bd1-bdf04e97d0ef tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.518s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLuoRdnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:35:26 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:35:26 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:35:26 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[250cc68e-637b-40e8-ba86-33cb3c940205]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:35:26 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b5ce1d-7cf6-471d-82c7-f6f4f25eaa85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633] added
Nov 06 22:35:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e0218-b3c0-48da-9ead-aa217097cc25]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fabdf5-6385-46ee-a1c1-eb14c558e27d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLuoRdnU {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLuoRdnU" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9a3220-8420-4657-8e17-8f8ef4e30cac]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TLuoRdnU'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d57530e-a8d7-4521-beb6-7d37b9e3d60b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f40cb74-a316-4670-9170-8efa8decd001]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:35:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:35:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f2e205-7b65-42db-809c-7a3738dd6a51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260]
Nov 06 22:35:26 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260] successful.
Nov 06 22:35:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed0528d-af0c-4dbb-aaa1-13e87530c02e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a561a1d5-e50a-47c2-96c4-1a40a11b1699]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:35:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:35:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:35:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:35:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00b12e8-9255-4954-9a49-002193d9b35d]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:35:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLuoRdnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:35:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:35:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23238356438643738', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:35:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238356438643738', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:35:27 user nova-compute[75000]: DEBUG nova.objects.instance [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:35:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:35:27 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:35:27 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:35:27 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:35:27 user nova-compute[75000]:   <serial>e80316b8-80c9-4a48-824d-b1c11fa1e633</serial>
Nov 06 22:35:27 user nova-compute[75000]: </disk>
Nov 06 22:35:27 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:35:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:35:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:35:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No VIF found with MAC fa:16:3e:a0:b0:4e, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:35:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cea4f1d6-dd80-4c24-a397-297f72cdf663 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.257s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:28 user nova-compute[75000]: INFO nova.compute.manager [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Terminating instance
Nov 06 22:35:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-087e2c9e-419d-4cf8-a1a4-106ab086e13a req-8172334c-569a-4e14-bde2-cef61bf2fb9e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-unplugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-087e2c9e-419d-4cf8-a1a4-106ab086e13a req-8172334c-569a-4e14-bde2-cef61bf2fb9e service nova] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-087e2c9e-419d-4cf8-a1a4-106ab086e13a req-8172334c-569a-4e14-bde2-cef61bf2fb9e service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-087e2c9e-419d-4cf8-a1a4-106ab086e13a req-8172334c-569a-4e14-bde2-cef61bf2fb9e service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-087e2c9e-419d-4cf8-a1a4-106ab086e13a req-8172334c-569a-4e14-bde2-cef61bf2fb9e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] No waiting events found dispatching network-vif-unplugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-087e2c9e-419d-4cf8-a1a4-106ab086e13a req-8172334c-569a-4e14-bde2-cef61bf2fb9e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-unplugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-585652e2-adcf-4301-a28e-ecafc6f0bf89 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-585652e2-adcf-4301-a28e-ecafc6f0bf89 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-585652e2-adcf-4301-a28e-ecafc6f0bf89 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-585652e2-adcf-4301-a28e-ecafc6f0bf89 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75000) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-585652e2-adcf-4301-a28e-ecafc6f0bf89 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Instance destroyed successfully.
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'resources' on Instance uuid 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1543740670',display_name='tempest-ServerActionsTestOtherA-server-899309665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1543740670',id=14,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmN/VyKWZXuRaaictuLTmDXlTum2xd2CWW45IjcqETXGMmR4MO8Nfu3+mUVy/T9OyJEtn7OQ4adADPNX/Sr89RqeTH93H8uReMub/zXCcqSw9dSeqiAoLDGj3NUacxE7g==',key_name='tempest-keypair-152635658',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:32:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-q79vaexu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=4367ded2-3cb6-44bc-a4a2-9b0b4bf98108,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "address": "fa:16:3e:c2:66:35", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap884e3b6b-4f", "ovs_interfaceid": "884e3b6b-4f31-4776-9d5c-b8f64388f438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG os_vif [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap884e3b6b-4f, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0743c9a4-3897-4b68-971d-b178151a291a) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:29 user nova-compute[75000]: INFO os_vif [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:66:35,bridge_name='br-int',has_traffic_filtering=True,id=884e3b6b-4f31-4776-9d5c-b8f64388f438,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap884e3b6b-4f')
Nov 06 22:35:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Deleting instance files /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108_del
Nov 06 22:35:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Deletion of /opt/stack/data/nova/instances/4367ded2-3cb6-44bc-a4a2-9b0b4bf98108_del complete
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-4066b9db-6069-4878-945b-afe7c2125740 req-2eb33188-ec88-44fa-9158-ebe60d0cddf8 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4066b9db-6069-4878-945b-afe7c2125740 req-2eb33188-ec88-44fa-9158-ebe60d0cddf8 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4066b9db-6069-4878-945b-afe7c2125740 req-2eb33188-ec88-44fa-9158-ebe60d0cddf8 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4066b9db-6069-4878-945b-afe7c2125740 req-2eb33188-ec88-44fa-9158-ebe60d0cddf8 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-4066b9db-6069-4878-945b-afe7c2125740 req-2eb33188-ec88-44fa-9158-ebe60d0cddf8 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:35:29 user nova-compute[75000]: WARNING nova.compute.manager [req-4066b9db-6069-4878-945b-afe7c2125740 req-2eb33188-ec88-44fa-9158-ebe60d0cddf8 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state active and task_state powering-off.
Nov 06 22:35:29 user nova-compute[75000]: INFO nova.compute.manager [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 06 22:35:29 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:35:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:30 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:30 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance destroyed successfully.
Nov 06 22:35:30 user nova-compute[75000]: DEBUG nova.compute.manager [None req-585652e2-adcf-4301-a28e-ecafc6f0bf89 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:35:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-585652e2-adcf-4301-a28e-ecafc6f0bf89 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.960s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:30 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:35:30 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Took 0.77 seconds to deallocate network for instance.
Nov 06 22:35:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-6ef90fa6-67c0-4fc2-825e-54713438f603 req-a7846eb6-c002-4720-96bf-21569faafa3e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-deleted-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:30 user nova-compute[75000]: INFO nova.compute.manager [req-6ef90fa6-67c0-4fc2-825e-54713438f603 req-a7846eb6-c002-4720-96bf-21569faafa3e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Neutron deleted interface 884e3b6b-4f31-4776-9d5c-b8f64388f438; detaching it from the instance and deleting it from the info cache
Nov 06 22:35:30 user nova-compute[75000]: DEBUG nova.network.neutron [req-6ef90fa6-67c0-4fc2-825e-54713438f603 req-a7846eb6-c002-4720-96bf-21569faafa3e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:35:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-6ef90fa6-67c0-4fc2-825e-54713438f603 req-a7846eb6-c002-4720-96bf-21569faafa3e service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Detach interface failed, port_id=884e3b6b-4f31-4776-9d5c-b8f64388f438, reason: Instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:35:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:31 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Deleted allocations for instance 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a620b97-28dd-4374-8983-b639ef079139 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-e06c40c8-17f7-4388-a60a-a01a9ce26da4 req-5fa71347-73cb-4b57-bf2a-32879a236f16 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e06c40c8-17f7-4388-a60a-a01a9ce26da4 req-5fa71347-73cb-4b57-bf2a-32879a236f16 service nova] Acquiring lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e06c40c8-17f7-4388-a60a-a01a9ce26da4 req-5fa71347-73cb-4b57-bf2a-32879a236f16 service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e06c40c8-17f7-4388-a60a-a01a9ce26da4 req-5fa71347-73cb-4b57-bf2a-32879a236f16 service nova] Lock "4367ded2-3cb6-44bc-a4a2-9b0b4bf98108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-e06c40c8-17f7-4388-a60a-a01a9ce26da4 req-5fa71347-73cb-4b57-bf2a-32879a236f16 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] No waiting events found dispatching network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:35:31 user nova-compute[75000]: WARNING nova.compute.manager [req-e06c40c8-17f7-4388-a60a-a01a9ce26da4 req-5fa71347-73cb-4b57-bf2a-32879a236f16 service nova] [instance: 4367ded2-3cb6-44bc-a4a2-9b0b4bf98108] Received unexpected event network-vif-plugged-884e3b6b-4f31-4776-9d5c-b8f64388f438 for instance with vm_state deleted and task_state None.
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updating instance_info_cache with network_info: [{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-ce6fd75e-b69e-4849-a74b-8d30835ab4a4 req-8ba7a92e-92fe-4346-9945-f8bbe9fbee25 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce6fd75e-b69e-4849-a74b-8d30835ab4a4 req-8ba7a92e-92fe-4346-9945-f8bbe9fbee25 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce6fd75e-b69e-4849-a74b-8d30835ab4a4 req-8ba7a92e-92fe-4346-9945-f8bbe9fbee25 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce6fd75e-b69e-4849-a74b-8d30835ab4a4 req-8ba7a92e-92fe-4346-9945-f8bbe9fbee25 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-ce6fd75e-b69e-4849-a74b-8d30835ab4a4 req-8ba7a92e-92fe-4346-9945-f8bbe9fbee25 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:35:31 user nova-compute[75000]: WARNING nova.compute.manager [req-ce6fd75e-b69e-4849-a74b-8d30835ab4a4 req-8ba7a92e-92fe-4346-9945-f8bbe9fbee25 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state stopped and task_state None.
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquiring lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquiring lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:35 user nova-compute[75000]: INFO nova.compute.manager [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Terminating instance
Nov 06 22:35:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-9f0f3582-85c8-422a-b55f-46c9d3ca7da8 req-c44ed8dc-bc5d-4d51-ac7b-4b1f9283b562 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received event network-vif-unplugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9f0f3582-85c8-422a-b55f-46c9d3ca7da8 req-c44ed8dc-bc5d-4d51-ac7b-4b1f9283b562 service nova] Acquiring lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9f0f3582-85c8-422a-b55f-46c9d3ca7da8 req-c44ed8dc-bc5d-4d51-ac7b-4b1f9283b562 service nova] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9f0f3582-85c8-422a-b55f-46c9d3ca7da8 req-c44ed8dc-bc5d-4d51-ac7b-4b1f9283b562 service nova] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-9f0f3582-85c8-422a-b55f-46c9d3ca7da8 req-c44ed8dc-bc5d-4d51-ac7b-4b1f9283b562 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] No waiting events found dispatching network-vif-unplugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG nova.compute.manager [req-9f0f3582-85c8-422a-b55f-46c9d3ca7da8 req-c44ed8dc-bc5d-4d51-ac7b-4b1f9283b562 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received event network-vif-unplugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:36 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Instance destroyed successfully.
Nov 06 22:35:36 user nova-compute[75000]: DEBUG nova.objects.instance [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lazy-loading 'resources' on Instance uuid 0efe3b45-ff8f-48fa-ab0f-822fb64b7272 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1267663327',display_name='tempest-VolumesNegativeTest-instance-1267663327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1267663327',id=22,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d5af326b8dc4db1a32887b2c76b2790',ramdisk_id='',reservation_id='r-fr5kmj6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1139098273',owner_user_name='tempest-VolumesNegativeTest-1139098273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:33:52Z,user_data=None,user_id='47f1f9b260fd45d1b880c6a61bf41ad0',uuid=0efe3b45-ff8f-48fa-ab0f-822fb64b7272,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Converting VIF {"id": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "address": "fa:16:3e:1e:b7:18", "network": {"id": "d6eef2c0-b6e9-44c6-98c4-a262032c8fef", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2c67dd7782834ebda48ea084ff9298ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d9b1f08-e4", "ovs_interfaceid": "3d9b1f08-e420-41fc-8e63-b09154b63f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b7:18,bridge_name='br-int',has_traffic_filtering=True,id=3d9b1f08-e420-41fc-8e63-b09154b63f76,network=Network(d6eef2c0-b6e9-44c6-98c4-a262032c8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b1f08-e4') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG os_vif [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b7:18,bridge_name='br-int',has_traffic_filtering=True,id=3d9b1f08-e420-41fc-8e63-b09154b63f76,network=Network(d6eef2c0-b6e9-44c6-98c4-a262032c8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b1f08-e4') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d9b1f08-e4, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2926a2a8-dc7a-4106-93d8-611d751aa09d) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:36 user nova-compute[75000]: INFO os_vif [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:b7:18,bridge_name='br-int',has_traffic_filtering=True,id=3d9b1f08-e420-41fc-8e63-b09154b63f76,network=Network(d6eef2c0-b6e9-44c6-98c4-a262032c8fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d9b1f08-e4')
Nov 06 22:35:36 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Deleting instance files /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272_del
Nov 06 22:35:36 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Deletion of /opt/stack/data/nova/instances/0efe3b45-ff8f-48fa-ab0f-822fb64b7272_del complete
Nov 06 22:35:36 user nova-compute[75000]: INFO nova.compute.manager [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:37 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:35:37 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7211MB free_disk=25.088314056396484GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:35:37 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Took 0.76 seconds to deallocate network for instance.
Nov 06 22:35:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0414d03a-aba0-44df-9cca-257ab81bde61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0efe3b45-ff8f-48fa-ab0f-822fb64b7272 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 3dfe6744-55ec-4294-8fda-5689879ed46b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 4632eded-e5f2-4e4d-8558-eb9af2e6aed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0bd209e9-b6c8-4663-a443-77d251b3d802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:35:37 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.523s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-5e945bb6-9807-43cf-8ff3-b0a3f568b7f7 req-baf9079b-c9fc-44b3-a6c6-f618e968e0c2 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received event network-vif-plugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5e945bb6-9807-43cf-8ff3-b0a3f568b7f7 req-baf9079b-c9fc-44b3-a6c6-f618e968e0c2 service nova] Acquiring lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5e945bb6-9807-43cf-8ff3-b0a3f568b7f7 req-baf9079b-c9fc-44b3-a6c6-f618e968e0c2 service nova] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5e945bb6-9807-43cf-8ff3-b0a3f568b7f7 req-baf9079b-c9fc-44b3-a6c6-f618e968e0c2 service nova] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-5e945bb6-9807-43cf-8ff3-b0a3f568b7f7 req-baf9079b-c9fc-44b3-a6c6-f618e968e0c2 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] No waiting events found dispatching network-vif-plugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:35:38 user nova-compute[75000]: WARNING nova.compute.manager [req-5e945bb6-9807-43cf-8ff3-b0a3f568b7f7 req-baf9079b-c9fc-44b3-a6c6-f618e968e0c2 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received unexpected event network-vif-plugged-3d9b1f08-e420-41fc-8e63-b09154b63f76 for instance with vm_state deleted and task_state None.
Nov 06 22:35:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-5e945bb6-9807-43cf-8ff3-b0a3f568b7f7 req-baf9079b-c9fc-44b3-a6c6-f618e968e0c2 service nova] [instance: 0efe3b45-ff8f-48fa-ab0f-822fb64b7272] Received event network-vif-deleted-3d9b1f08-e420-41fc-8e63-b09154b63f76 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:38 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Deleted allocations for instance 0efe3b45-ff8f-48fa-ab0f-822fb64b7272
Nov 06 22:35:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d06335f3-60e6-4507-a789-5acdfa085b0d tempest-VolumesNegativeTest-1139098273 tempest-VolumesNegativeTest-1139098273-project-member] Lock "0efe3b45-ff8f-48fa-ab0f-822fb64b7272" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.937s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:35:56 user nova-compute[75000]: INFO nova.compute.manager [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] instance snapshotting
Nov 06 22:35:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:35:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Beginning live snapshot process
Nov 06 22:35:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:35:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json -f qcow2 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:35:57 user nova-compute[75000]: INFO nova.compute.claims [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Claim successful on node user
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json -f qcow2 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeizhchtz/bfebfe19af734972ac2fcd0fbdda9722.delta 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeizhchtz/bfebfe19af734972ac2fcd0fbdda9722.delta 1073741824" returned: 0 in 0.059s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.659s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:35:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.policy [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33f333b132a1474d983798ab0642b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf4f6360f6c486ab24087a20da8b6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:35:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Creating image(s)
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "/opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "/opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "/opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk 1073741824" returned: 0 in 0.135s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 22:35:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Cannot resize image /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Ensure instance console log exists: /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:35:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Successfully created port: 26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeizhchtz/bfebfe19af734972ac2fcd0fbdda9722.delta /opt/stack/data/nova/instances/snapshots/tmpeizhchtz/bfebfe19af734972ac2fcd0fbdda9722 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeizhchtz/bfebfe19af734972ac2fcd0fbdda9722.delta /opt/stack/data/nova/instances/snapshots/tmpeizhchtz/bfebfe19af734972ac2fcd0fbdda9722" returned: 0 in 0.536s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:35:59 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Snapshot extracted, beginning image upload
Nov 06 22:35:59 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Successfully updated port: 26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "refresh_cache-c06fdcaf-015a-4f5e-9907-c95d1a775141" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquired lock "refresh_cache-c06fdcaf-015a-4f5e-9907-c95d1a775141" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-6fabcd13-be87-4409-b819-26422ecf1f2d req-f9e7df0e-7896-481f-8c8b-1bc1ab8813bf service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received event network-changed-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-6fabcd13-be87-4409-b819-26422ecf1f2d req-f9e7df0e-7896-481f-8c8b-1bc1ab8813bf service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Refreshing instance network info cache due to event network-changed-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6fabcd13-be87-4409-b819-26422ecf1f2d req-f9e7df0e-7896-481f-8c8b-1bc1ab8813bf service nova] Acquiring lock "refresh_cache-c06fdcaf-015a-4f5e-9907-c95d1a775141" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:35:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Updating instance_info_cache with network_info: [{"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Releasing lock "refresh_cache-c06fdcaf-015a-4f5e-9907-c95d1a775141" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Instance network_info: |[{"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6fabcd13-be87-4409-b819-26422ecf1f2d req-f9e7df0e-7896-481f-8c8b-1bc1ab8813bf service nova] Acquired lock "refresh_cache-c06fdcaf-015a-4f5e-9907-c95d1a775141" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.network.neutron [req-6fabcd13-be87-4409-b819-26422ecf1f2d req-f9e7df0e-7896-481f-8c8b-1bc1ab8813bf service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Refreshing network info cache for port 26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Start _get_guest_xml network_info=[{"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:36:00 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:36:00 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-805775064',display_name='tempest-AttachVolumeNegativeTest-server-805775064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-805775064',id=27,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIDtXdy1OBsBr8wMrswpfKMGLt3e2x2jlTrE7ss/D7h58uBYmvVfnraw8HHbSezuJ+lYMe8owPZlhv9+GoqOEylGJbjPufHZNvzTJPT0bELSGq1esbEDsfWw6rYSx3Zsg==',key_name='tempest-keypair-684394860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-6z8sc9cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=c06fdcaf-015a-4f5e-9907-c95d1a775141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:51:e5,bridge_name='br-int',has_traffic_filtering=True,id=26e57c36-87d2-49f8-9d8b-1d3436e3a7d0,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e57c36-87') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'pci_devices' on Instance uuid c06fdcaf-015a-4f5e-9907-c95d1a775141 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:36:00 user nova-compute[75000]:   <uuid>c06fdcaf-015a-4f5e-9907-c95d1a775141</uuid>
Nov 06 22:36:00 user nova-compute[75000]:   <name>instance-0000001b</name>
Nov 06 22:36:00 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:36:00 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:36:00 user nova-compute[75000]:   <metadata>
Nov 06 22:36:00 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:36:00 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:36:00 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeNegativeTest-server-805775064</nova:name>
Nov 06 22:36:00 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:36:00</nova:creationTime>
Nov 06 22:36:00 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:36:00 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:36:00 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:36:00 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:36:00 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:36:00 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:36:00 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:36:00 user nova-compute[75000]:       <nova:owner>
Nov 06 22:36:00 user nova-compute[75000]:         <nova:user uuid="33f333b132a1474d983798ab0642b053">tempest-AttachVolumeNegativeTest-90304964-project-member</nova:user>
Nov 06 22:36:00 user nova-compute[75000]:         <nova:project uuid="0cf4f6360f6c486ab24087a20da8b6cb">tempest-AttachVolumeNegativeTest-90304964</nova:project>
Nov 06 22:36:00 user nova-compute[75000]:       </nova:owner>
Nov 06 22:36:00 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:36:00 user nova-compute[75000]:       <nova:ports>
Nov 06 22:36:00 user nova-compute[75000]:         <nova:port uuid="26e57c36-87d2-49f8-9d8b-1d3436e3a7d0">
Nov 06 22:36:00 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 22:36:00 user nova-compute[75000]:         </nova:port>
Nov 06 22:36:00 user nova-compute[75000]:       </nova:ports>
Nov 06 22:36:00 user nova-compute[75000]:     </nova:instance>
Nov 06 22:36:00 user nova-compute[75000]:   </metadata>
Nov 06 22:36:00 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:36:00 user nova-compute[75000]:     <system>
Nov 06 22:36:00 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:36:00 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:36:00 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:36:00 user nova-compute[75000]:       <entry name="serial">c06fdcaf-015a-4f5e-9907-c95d1a775141</entry>
Nov 06 22:36:00 user nova-compute[75000]:       <entry name="uuid">c06fdcaf-015a-4f5e-9907-c95d1a775141</entry>
Nov 06 22:36:00 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:36:00 user nova-compute[75000]:     </system>
Nov 06 22:36:00 user nova-compute[75000]:   </sysinfo>
Nov 06 22:36:00 user nova-compute[75000]:   <os>
Nov 06 22:36:00 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:36:00 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:36:00 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:36:00 user nova-compute[75000]:   </os>
Nov 06 22:36:00 user nova-compute[75000]:   <features>
Nov 06 22:36:00 user nova-compute[75000]:     <acpi/>
Nov 06 22:36:00 user nova-compute[75000]:     <apic/>
Nov 06 22:36:00 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:36:00 user nova-compute[75000]:   </features>
Nov 06 22:36:00 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:36:00 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:36:00 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:36:00 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:36:00 user nova-compute[75000]:   </clock>
Nov 06 22:36:00 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:36:00 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:36:00 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:36:00 user nova-compute[75000]:   </cpu>
Nov 06 22:36:00 user nova-compute[75000]:   <devices>
Nov 06 22:36:00 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:36:00 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:36:00 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk"/>
Nov 06 22:36:00 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:36:00 user nova-compute[75000]:     </disk>
Nov 06 22:36:00 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:36:00 user nova-compute[75000]:       <mac address="fa:16:3e:48:51:e5"/>
Nov 06 22:36:00 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:36:00 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:36:00 user nova-compute[75000]:       <target dev="tap26e57c36-87"/>
Nov 06 22:36:00 user nova-compute[75000]:     </interface>
Nov 06 22:36:00 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:36:00 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/console.log" append="off"/>
Nov 06 22:36:00 user nova-compute[75000]:     </serial>
Nov 06 22:36:00 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:36:00 user nova-compute[75000]:     <video>
Nov 06 22:36:00 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:36:00 user nova-compute[75000]:     </video>
Nov 06 22:36:00 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:36:00 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:36:00 user nova-compute[75000]:     </rng>
Nov 06 22:36:00 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:36:00 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:36:00 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:36:00 user nova-compute[75000]:     </memballoon>
Nov 06 22:36:00 user nova-compute[75000]:   </devices>
Nov 06 22:36:00 user nova-compute[75000]: </domain>
Nov 06 22:36:00 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-805775064',display_name='tempest-AttachVolumeNegativeTest-server-805775064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-805775064',id=27,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIDtXdy1OBsBr8wMrswpfKMGLt3e2x2jlTrE7ss/D7h58uBYmvVfnraw8HHbSezuJ+lYMe8owPZlhv9+GoqOEylGJbjPufHZNvzTJPT0bELSGq1esbEDsfWw6rYSx3Zsg==',key_name='tempest-keypair-684394860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-6z8sc9cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=c06fdcaf-015a-4f5e-9907-c95d1a775141,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:51:e5,bridge_name='br-int',has_traffic_filtering=True,id=26e57c36-87d2-49f8-9d8b-1d3436e3a7d0,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e57c36-87') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG os_vif [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:51:e5,bridge_name='br-int',has_traffic_filtering=True,id=26e57c36-87d2-49f8-9d8b-1d3436e3a7d0,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e57c36-87') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb93a37b-7ce5-5b27-91f7-cda3d5746eec', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26e57c36-87, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26e57c36-87, col_values=(('qos', UUID('75cd91c0-522a-497f-b8e8-0a51bdd8cab3')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26e57c36-87, col_values=(('external_ids', {'iface-id': '26e57c36-87d2-49f8-9d8b-1d3436e3a7d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:51:e5', 'vm-uuid': 'c06fdcaf-015a-4f5e-9907-c95d1a775141'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:00 user nova-compute[75000]: INFO os_vif [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:51:e5,bridge_name='br-int',has_traffic_filtering=True,id=26e57c36-87d2-49f8-9d8b-1d3436e3a7d0,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e57c36-87')
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No VIF found with MAC fa:16:3e:48:51:e5, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.network.neutron [req-6fabcd13-be87-4409-b819-26422ecf1f2d req-f9e7df0e-7896-481f-8c8b-1bc1ab8813bf service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Updated VIF entry in instance network info cache for port 26e57c36-87d2-49f8-9d8b-1d3436e3a7d0. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG nova.network.neutron [req-6fabcd13-be87-4409-b819-26422ecf1f2d req-f9e7df0e-7896-481f-8c8b-1bc1ab8813bf service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Updating instance_info_cache with network_info: [{"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:36:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6fabcd13-be87-4409-b819-26422ecf1f2d req-f9e7df0e-7896-481f-8c8b-1bc1ab8813bf service nova] Releasing lock "refresh_cache-c06fdcaf-015a-4f5e-9907-c95d1a775141" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:36:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-504793f9-c826-46cd-9b3f-a93c9c219fa6 req-dd1d2025-3cb3-419e-8cd5-4baf030cbd53 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received event network-vif-plugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-504793f9-c826-46cd-9b3f-a93c9c219fa6 req-dd1d2025-3cb3-419e-8cd5-4baf030cbd53 service nova] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-504793f9-c826-46cd-9b3f-a93c9c219fa6 req-dd1d2025-3cb3-419e-8cd5-4baf030cbd53 service nova] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-504793f9-c826-46cd-9b3f-a93c9c219fa6 req-dd1d2025-3cb3-419e-8cd5-4baf030cbd53 service nova] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-504793f9-c826-46cd-9b3f-a93c9c219fa6 req-dd1d2025-3cb3-419e-8cd5-4baf030cbd53 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] No waiting events found dispatching network-vif-plugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:36:02 user nova-compute[75000]: WARNING nova.compute.manager [req-504793f9-c826-46cd-9b3f-a93c9c219fa6 req-dd1d2025-3cb3-419e-8cd5-4baf030cbd53 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received unexpected event network-vif-plugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 for instance with vm_state building and task_state spawning.
Nov 06 22:36:02 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Snapshot image upload complete
Nov 06 22:36:02 user nova-compute[75000]: INFO nova.compute.manager [None req-6761c379-ff17-4f4b-a768-fc5fe1eb83dc tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Took 6.01 seconds to snapshot the instance on the hypervisor.
Nov 06 22:36:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:36:04 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Instance spawned successfully.
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:36:04 user nova-compute[75000]: INFO nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-3ffbf4d2-891d-4305-a2eb-3e65b971c963 req-c64adeef-8111-4d5b-b1a6-9a467885099f service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received event network-vif-plugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3ffbf4d2-891d-4305-a2eb-3e65b971c963 req-c64adeef-8111-4d5b-b1a6-9a467885099f service nova] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3ffbf4d2-891d-4305-a2eb-3e65b971c963 req-c64adeef-8111-4d5b-b1a6-9a467885099f service nova] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3ffbf4d2-891d-4305-a2eb-3e65b971c963 req-c64adeef-8111-4d5b-b1a6-9a467885099f service nova] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-3ffbf4d2-891d-4305-a2eb-3e65b971c963 req-c64adeef-8111-4d5b-b1a6-9a467885099f service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] No waiting events found dispatching network-vif-plugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:36:04 user nova-compute[75000]: WARNING nova.compute.manager [req-3ffbf4d2-891d-4305-a2eb-3e65b971c963 req-c64adeef-8111-4d5b-b1a6-9a467885099f service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received unexpected event network-vif-plugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 for instance with vm_state building and task_state spawning.
Nov 06 22:36:04 user nova-compute[75000]: INFO nova.compute.manager [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Took 7.30 seconds to build instance.
Nov 06 22:36:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a8a55730-494b-4395-b2e7-e3e8852eb298 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.403s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-b9ff3569-51fb-43c7-bf79-bd5f0d808fb6 req-22f59d97-4d66-4e57-a8ac-c175845616e7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-changed-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-b9ff3569-51fb-43c7-bf79-bd5f0d808fb6 req-22f59d97-4d66-4e57-a8ac-c175845616e7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Refreshing instance network info cache due to event network-changed-7d134985-3e0b-4352-a829-46cc9efcaaa3. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:36:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b9ff3569-51fb-43c7-bf79-bd5f0d808fb6 req-22f59d97-4d66-4e57-a8ac-c175845616e7 service nova] Acquiring lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:36:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b9ff3569-51fb-43c7-bf79-bd5f0d808fb6 req-22f59d97-4d66-4e57-a8ac-c175845616e7 service nova] Acquired lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:36:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-b9ff3569-51fb-43c7-bf79-bd5f0d808fb6 req-22f59d97-4d66-4e57-a8ac-c175845616e7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Refreshing network info cache for port 7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:36:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'flavor' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:09 user nova-compute[75000]: INFO nova.compute.manager [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Attaching volume d2c4eb58-53b5-401f-b93d-85ab09be2363 to /dev/vdb
Nov 06 22:36:09 user nova-compute[75000]: DEBUG os_brick.utils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-b9ff3569-51fb-43c7-bf79-bd5f0d808fb6 req-22f59d97-4d66-4e57-a8ac-c175845616e7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updated VIF entry in instance network info cache for port 7d134985-3e0b-4352-a829-46cc9efcaaa3. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-b9ff3569-51fb-43c7-bf79-bd5f0d808fb6 req-22f59d97-4d66-4e57-a8ac-c175845616e7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updating instance_info_cache with network_info: [{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e326b8b-e2e1-4150-b924-5b856a22fb87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b9ff3569-51fb-43c7-bf79-bd5f0d808fb6 req-22f59d97-4d66-4e57-a8ac-c175845616e7 service nova] Releasing lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb6225-6147-4e9e-9eba-fcc4bfe37100]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72faef83-3749-4e20-a7c0-f4cdaf57b4b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b17d604-d84a-44ca-a785-b93fa26a8a8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:36:09 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:36:09 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c04f8c5-e168-4934-b455-3ae0e43d118e]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG os_brick.utils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updating existing volume attachment record: 58ae8a93-b1a9-495d-bdde-8947cbbd086e {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:36:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:24 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:29 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 22:36:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 22:36:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:30 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:30 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 22:36:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:31 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updating instance_info_cache with network_info: [{"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-b2c6375a-d847-45e8-a0e8-42b37eb0af7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:36:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsKmtBrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:36:33 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:36:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:36:33 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:36:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:36:33 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0ed30f-3bdd-4096-afee-d53288d85b3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:36:33 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e228ba2c-2321-41e6-86ff-b879342fd917]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363] added
Nov 06 22:36:33 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[078b2d16-8875-425d-af3e-18f68d09f9eb]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:36:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[936103c4-ce93-47e9-98c3-4423f239b649]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsKmtBrl {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsKmtBrl" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92e4bae-f011-4b27-8211-60f649224704]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FsKmtBrl'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e313ecee-9b16-4d7c-9086-470e313fb06d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b5947-bbf1-4415-9af4-703530637b93]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8970a4f8-170e-4df4-b99e-153be4464e5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363, portal: 172.16.0.220,3260]
Nov 06 22:36:34 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363, portal: 172.16.0.220,3260] successful.
Nov 06 22:36:34 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd569e4a-f730-4e83-aac8-f9b025021869]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2bd830-e42f-482f-8d15-427e853e910f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:36:34 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc792d2-b27a-41b2-8d54-8c3c78e5ddc6]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:34 user nova-compute[75000]: INFO nova.compute.manager [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Terminating instance
Nov 06 22:36:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-41afc328-4250-4a11-bb0c-0717b6ff6f6c req-acff5aed-f5e5-4591-8b9b-9407080915ed service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received event network-vif-unplugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-41afc328-4250-4a11-bb0c-0717b6ff6f6c req-acff5aed-f5e5-4591-8b9b-9407080915ed service nova] Acquiring lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-41afc328-4250-4a11-bb0c-0717b6ff6f6c req-acff5aed-f5e5-4591-8b9b-9407080915ed service nova] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-41afc328-4250-4a11-bb0c-0717b6ff6f6c req-acff5aed-f5e5-4591-8b9b-9407080915ed service nova] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-41afc328-4250-4a11-bb0c-0717b6ff6f6c req-acff5aed-f5e5-4591-8b9b-9407080915ed service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] No waiting events found dispatching network-vif-unplugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-41afc328-4250-4a11-bb0c-0717b6ff6f6c req-acff5aed-f5e5-4591-8b9b-9407080915ed service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received event network-vif-unplugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsKmtBrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26136623330313835', 'path': '/dev/sdd'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136623330313835', 'path': '/dev/sdd'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'flavor' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:36:35 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:36:35 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 22:36:35 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:36:35 user nova-compute[75000]:   <serial>d2c4eb58-53b5-401f-b93d-85ab09be2363</serial>
Nov 06 22:36:35 user nova-compute[75000]: </disk>
Nov 06 22:36:35 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Instance destroyed successfully.
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.objects.instance [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lazy-loading 'resources' on Instance uuid 4632eded-e5f2-4e4d-8558-eb9af2e6aed5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1055503720',display_name='tempest-VolumesAdminNegativeTest-server-1055503720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1055503720',id=25,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='121f8a74b2de48a69627c6fc564d023f',ramdisk_id='',reservation_id='r-25xasg7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1947874717',owner_user_name='tempest-VolumesAdminNegativeTest-1947874717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:34:37Z,user_data=None,user_id='89f94a3ce27c483fabb4a3bcf053f141',uuid=4632eded-e5f2-4e4d-8558-eb9af2e6aed5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converting VIF {"id": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "address": "fa:16:3e:2e:03:83", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d8cd6a6-ea", "ovs_interfaceid": "7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:03:83,bridge_name='br-int',has_traffic_filtering=True,id=7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8cd6a6-ea') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG os_vif [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:03:83,bridge_name='br-int',has_traffic_filtering=True,id=7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8cd6a6-ea') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d8cd6a6-ea, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7a56d41-2af9-4eca-aba9-6e69f2a405a5) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:35 user nova-compute[75000]: INFO os_vif [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:03:83,bridge_name='br-int',has_traffic_filtering=True,id=7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d8cd6a6-ea')
Nov 06 22:36:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Deleting instance files /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5_del
Nov 06 22:36:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Deletion of /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5_del complete
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk --force-share --output=json" returned: 1 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk --force-share --output=json' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:36:35 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000019, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/4632eded-e5f2-4e4d-8558-eb9af2e6aed5/disk
Nov 06 22:36:35 user nova-compute[75000]: INFO nova.compute.manager [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:36:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No VIF found with MAC fa:16:3e:91:2e:d2, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8c542209-8702-4132-9b70-e43afc980a07 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.033s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:36:36 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Took 0.52 seconds to deallocate network for instance.
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 22:36:36 user nova-compute[75000]: INFO nova.compute.manager [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Rescuing
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquired lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-e8ca097a-bb26-425c-a690-0904086d7793 req-694b9542-60a1-4637-bc1a-028ea7c078e1 service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received event network-vif-plugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8ca097a-bb26-425c-a690-0904086d7793 req-694b9542-60a1-4637-bc1a-028ea7c078e1 service nova] Acquiring lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8ca097a-bb26-425c-a690-0904086d7793 req-694b9542-60a1-4637-bc1a-028ea7c078e1 service nova] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8ca097a-bb26-425c-a690-0904086d7793 req-694b9542-60a1-4637-bc1a-028ea7c078e1 service nova] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-e8ca097a-bb26-425c-a690-0904086d7793 req-694b9542-60a1-4637-bc1a-028ea7c078e1 service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] No waiting events found dispatching network-vif-plugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:36:37 user nova-compute[75000]: WARNING nova.compute.manager [req-e8ca097a-bb26-425c-a690-0904086d7793 req-694b9542-60a1-4637-bc1a-028ea7c078e1 service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received unexpected event network-vif-plugged-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba for instance with vm_state deleted and task_state None.
Nov 06 22:36:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-e8ca097a-bb26-425c-a690-0904086d7793 req-694b9542-60a1-4637-bc1a-028ea7c078e1 service nova] [instance: 4632eded-e5f2-4e4d-8558-eb9af2e6aed5] Received event network-vif-deleted-7d8cd6a6-ea1c-44b9-be1b-2eb0f955baba {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.940s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:37 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Deleted allocations for instance 4632eded-e5f2-4e4d-8558-eb9af2e6aed5
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c223d33-1fc4-40a8-92a2-700e70392cbe tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "4632eded-e5f2-4e4d-8558-eb9af2e6aed5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updating instance_info_cache with network_info: [{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Releasing lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Instance destroyed successfully.
Nov 06 22:36:38 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:36:38 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:36:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7397MB free_disk=24.997486114501953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Attempting rescue
Nov 06 22:36:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Instance directory exists: not creating {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 22:36:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Creating image(s)
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0414d03a-aba0-44df-9cca-257ab81bde61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 3dfe6744-55ec-4294-8fda-5689879ed46b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0bd209e9-b6c8-4663-a443-77d251b3d802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c06fdcaf-015a-4f5e-9907-c95d1a775141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.rescue {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.rescue" returned: 0 in 0.056s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'migration_context' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.base [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<3dfe6744-55ec-4294-8fda-5689879ed46b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Start _get_guest_xml network_info=[{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "vif_mac": "fa:16:3e:91:2e:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'resources' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.base [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<3dfe6744-55ec-4294-8fda-5689879ed46b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'numa_topology' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.base [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<3dfe6744-55ec-4294-8fda-5689879ed46b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:36:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:36:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.base [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<3dfe6744-55ec-4294-8fda-5689879ed46b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-767875355',display_name='tempest-ServerRescueNegativeTestJSON-server-767875355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-767875355',id=24,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdTqiSrMqRl+yglj84awVX1hdMP+cCKbd7CLQXPSJ3xZ+8VIStP539jNk65vUlH6hoLPRWMdxprcJ8AVIS+526F1aYdGyOUIMI+uHEm3yCZPpspfjLampZy1EaJS8pbcg==',key_name='tempest-keypair-340254793',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:34:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-pifvb90z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:34:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f50e6a64752e488b9699a8bdda46253c',uuid=3dfe6744-55ec-4294-8fda-5689879ed46b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "vif_mac": "fa:16:3e:91:2e:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "vif_mac": "fa:16:3e:91:2e:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:2e:d2,bridge_name='br-int',has_traffic_filtering=True,id=7d134985-3e0b-4352-a829-46cc9efcaaa3,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d134985-3e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.objects.base [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Object Instance<3dfe6744-55ec-4294-8fda-5689879ed46b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:36:39 user nova-compute[75000]:   <uuid>3dfe6744-55ec-4294-8fda-5689879ed46b</uuid>
Nov 06 22:36:39 user nova-compute[75000]:   <name>instance-00000018</name>
Nov 06 22:36:39 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:36:39 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:36:39 user nova-compute[75000]:   <metadata>
Nov 06 22:36:39 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:36:39 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:36:39 user nova-compute[75000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-767875355</nova:name>
Nov 06 22:36:39 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:36:39</nova:creationTime>
Nov 06 22:36:39 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:36:39 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:36:39 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:36:39 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:36:39 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:36:39 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:36:39 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:36:39 user nova-compute[75000]:       <nova:owner>
Nov 06 22:36:39 user nova-compute[75000]:         <nova:user uuid="f50e6a64752e488b9699a8bdda46253c">tempest-ServerRescueNegativeTestJSON-259573853-project-member</nova:user>
Nov 06 22:36:39 user nova-compute[75000]:         <nova:project uuid="5b4b9d5ecee54acb8ca3534a38500b4f">tempest-ServerRescueNegativeTestJSON-259573853</nova:project>
Nov 06 22:36:39 user nova-compute[75000]:       </nova:owner>
Nov 06 22:36:39 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:36:39 user nova-compute[75000]:       <nova:ports>
Nov 06 22:36:39 user nova-compute[75000]:         <nova:port uuid="7d134985-3e0b-4352-a829-46cc9efcaaa3">
Nov 06 22:36:39 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 22:36:39 user nova-compute[75000]:         </nova:port>
Nov 06 22:36:39 user nova-compute[75000]:       </nova:ports>
Nov 06 22:36:39 user nova-compute[75000]:     </nova:instance>
Nov 06 22:36:39 user nova-compute[75000]:   </metadata>
Nov 06 22:36:39 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:36:39 user nova-compute[75000]:     <system>
Nov 06 22:36:39 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:36:39 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:36:39 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:36:39 user nova-compute[75000]:       <entry name="serial">3dfe6744-55ec-4294-8fda-5689879ed46b</entry>
Nov 06 22:36:39 user nova-compute[75000]:       <entry name="uuid">3dfe6744-55ec-4294-8fda-5689879ed46b</entry>
Nov 06 22:36:39 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:36:39 user nova-compute[75000]:     </system>
Nov 06 22:36:39 user nova-compute[75000]:   </sysinfo>
Nov 06 22:36:39 user nova-compute[75000]:   <os>
Nov 06 22:36:39 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:36:39 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:36:39 user nova-compute[75000]:   </os>
Nov 06 22:36:39 user nova-compute[75000]:   <features>
Nov 06 22:36:39 user nova-compute[75000]:     <acpi/>
Nov 06 22:36:39 user nova-compute[75000]:     <apic/>
Nov 06 22:36:39 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:36:39 user nova-compute[75000]:   </features>
Nov 06 22:36:39 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:36:39 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:36:39 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:36:39 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:36:39 user nova-compute[75000]:   </clock>
Nov 06 22:36:39 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:36:39 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:36:39 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:36:39 user nova-compute[75000]:   </cpu>
Nov 06 22:36:39 user nova-compute[75000]:   <devices>
Nov 06 22:36:39 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:36:39 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:36:39 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.rescue"/>
Nov 06 22:36:39 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:36:39 user nova-compute[75000]:     </disk>
Nov 06 22:36:39 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:36:39 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:36:39 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk"/>
Nov 06 22:36:39 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:36:39 user nova-compute[75000]:     </disk>
Nov 06 22:36:39 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:36:39 user nova-compute[75000]:       <mac address="fa:16:3e:91:2e:d2"/>
Nov 06 22:36:39 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:36:39 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:36:39 user nova-compute[75000]:       <target dev="tap7d134985-3e"/>
Nov 06 22:36:39 user nova-compute[75000]:     </interface>
Nov 06 22:36:39 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:36:39 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/console.log" append="off"/>
Nov 06 22:36:39 user nova-compute[75000]:     </serial>
Nov 06 22:36:39 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:36:39 user nova-compute[75000]:     <video>
Nov 06 22:36:39 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:36:39 user nova-compute[75000]:     </video>
Nov 06 22:36:39 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:36:39 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:36:39 user nova-compute[75000]:     </rng>
Nov 06 22:36:39 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:36:39 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:36:39 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:36:39 user nova-compute[75000]:     </memballoon>
Nov 06 22:36:39 user nova-compute[75000]:   </devices>
Nov 06 22:36:39 user nova-compute[75000]: </domain>
Nov 06 22:36:39 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-unplugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-unplugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:36:39 user nova-compute[75000]: WARNING nova.compute.manager [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-unplugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state active and task_state rescuing.
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:36:39 user nova-compute[75000]: WARNING nova.compute.manager [req-dcaee77c-8ef8-4f45-b1ee-9956814da17e req-dc28610a-65a3-4cce-af4a-87578a8f9505 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state active and task_state rescuing.
Nov 06 22:36:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Instance destroyed successfully.
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] No VIF found with MAC fa:16:3e:91:2e:d2, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:36:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:36:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:36:41 user nova-compute[75000]: WARNING nova.compute.manager [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state active and task_state rescuing.
Nov 06 22:36:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:36:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:36:41 user nova-compute[75000]: WARNING nova.compute.manager [req-ae9ed5f9-5336-4b22-8216-dc07173ef656 req-c696184b-dc23-43c4-b44e-6b9372eddf12 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state active and task_state rescuing.
Nov 06 22:36:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4c9012f1-7a17-426b-92f1-e5c77539c3bf tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:36:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:36:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:36:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:36:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:36:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:36:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:36:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:36:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:37:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:04 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:37:04 user nova-compute[75000]: INFO nova.compute.claims [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Claim successful on node user
Nov 06 22:37:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-b1a4a3cc-0a71-4924-8e1b-695b0c524aa6 req-7a7d7b7b-9413-41b1-b167-98c242c0b7ff service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received event network-changed-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-b1a4a3cc-0a71-4924-8e1b-695b0c524aa6 req-7a7d7b7b-9413-41b1-b167-98c242c0b7ff service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Refreshing instance network info cache due to event network-changed-8cdb01ae-906f-4ff4-bc2c-2511cce726de. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b1a4a3cc-0a71-4924-8e1b-695b0c524aa6 req-7a7d7b7b-9413-41b1-b167-98c242c0b7ff service nova] Acquiring lock "refresh_cache-0bd209e9-b6c8-4663-a443-77d251b3d802" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b1a4a3cc-0a71-4924-8e1b-695b0c524aa6 req-7a7d7b7b-9413-41b1-b167-98c242c0b7ff service nova] Acquired lock "refresh_cache-0bd209e9-b6c8-4663-a443-77d251b3d802" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-b1a4a3cc-0a71-4924-8e1b-695b0c524aa6 req-7a7d7b7b-9413-41b1-b167-98c242c0b7ff service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Refreshing network info cache for port 8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:37:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:37:05 user nova-compute[75000]: INFO nova.virt.block_device [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Booting with volume-backed-image cf3cd688-ea7b-402f-a42c-d141d8f6e4e9 at /dev/vda
Nov 06 22:37:05 user nova-compute[75000]: DEBUG nova.policy [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddbbf039233142eca9f4cdfe2396da7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7a8c838f784f309fb9f0066e3463ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:37:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-b1a4a3cc-0a71-4924-8e1b-695b0c524aa6 req-7a7d7b7b-9413-41b1-b167-98c242c0b7ff service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Updated VIF entry in instance network info cache for port 8cdb01ae-906f-4ff4-bc2c-2511cce726de. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-b1a4a3cc-0a71-4924-8e1b-695b0c524aa6 req-7a7d7b7b-9413-41b1-b167-98c242c0b7ff service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Updating instance_info_cache with network_info: [{"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b1a4a3cc-0a71-4924-8e1b-695b0c524aa6 req-7a7d7b7b-9413-41b1-b167-98c242c0b7ff service nova] Releasing lock "refresh_cache-0bd209e9-b6c8-4663-a443-77d251b3d802" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Successfully created port: e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG nova.objects.instance [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lazy-loading 'flavor' on Instance uuid 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:06 user nova-compute[75000]: INFO nova.compute.manager [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Attaching volume b71d212c-c8c9-49a4-9f55-9c38d90a45f4 to /dev/vdb
Nov 06 22:37:07 user nova-compute[75000]: DEBUG os_brick.utils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c260677b-804c-4adf-ba45-1003b6c4bf69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d0b5ac-4415-43ac-bbbf-036595396cac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ba9c3a-3841-4ff5-83fe-81518941ed1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c2f29a-b851-4dfe-9b6d-11a6a6f9b7a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:37:07 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[18707b3b-3d32-45c3-b8e7-ea06c644c71a]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG os_brick.utils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Updating existing volume attachment record: 13b2d375-42b2-4df9-9580-628166ffca23 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Successfully updated port: e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquired lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-27768b30-f0aa-4383-b801-e08007cf642b req-59390d21-ae80-4e56-92eb-03c827b5ead7 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-changed-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-27768b30-f0aa-4383-b801-e08007cf642b req-59390d21-ae80-4e56-92eb-03c827b5ead7 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Refreshing instance network info cache due to event network-changed-e93a0138-d9ce-4443-86c8-7325fd6fd86a. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-27768b30-f0aa-4383-b801-e08007cf642b req-59390d21-ae80-4e56-92eb-03c827b5ead7 service nova] Acquiring lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Updating instance_info_cache with network_info: [{"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Releasing lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Instance network_info: |[{"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-27768b30-f0aa-4383-b801-e08007cf642b req-59390d21-ae80-4e56-92eb-03c827b5ead7 service nova] Acquired lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:37:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-27768b30-f0aa-4383-b801-e08007cf642b req-59390d21-ae80-4e56-92eb-03c827b5ead7 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Refreshing network info cache for port e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:37:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-27768b30-f0aa-4383-b801-e08007cf642b req-59390d21-ae80-4e56-92eb-03c827b5ead7 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Updated VIF entry in instance network info cache for port e93a0138-d9ce-4443-86c8-7325fd6fd86a. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:37:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-27768b30-f0aa-4383-b801-e08007cf642b req-59390d21-ae80-4e56-92eb-03c827b5ead7 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Updating instance_info_cache with network_info: [{"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-27768b30-f0aa-4383-b801-e08007cf642b req-59390d21-ae80-4e56-92eb-03c827b5ead7 service nova] Releasing lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:37:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:37:12 user nova-compute[75000]: INFO nova.compute.claims [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Claim successful on node user
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:37:12 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.policy [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c02a9118b9a4e388a81b388169fd773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd778f501c55549db895391e5bb73dc26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:37:12 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Creating image(s)
Nov 06 22:37:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "/opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "/opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk 1073741824" returned: 0 in 0.047s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Successfully created port: 8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Cannot resize image /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Ensure instance console log exists: /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Successfully updated port: 8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquired lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-59d7f5ec-5cef-4340-b1b9-eabd10734e6f req-90e3d138-d35d-4957-bc19-5acaf9a54c9b service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received event network-changed-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-59d7f5ec-5cef-4340-b1b9-eabd10734e6f req-90e3d138-d35d-4957-bc19-5acaf9a54c9b service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Refreshing instance network info cache due to event network-changed-8106fcc8-1c86-4441-8f27-462700afb2f2. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59d7f5ec-5cef-4340-b1b9-eabd10734e6f req-90e3d138-d35d-4957-bc19-5acaf9a54c9b service nova] Acquiring lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.network.neutron [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating instance_info_cache with network_info: [{"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Releasing lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Instance network_info: |[{"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59d7f5ec-5cef-4340-b1b9-eabd10734e6f req-90e3d138-d35d-4957-bc19-5acaf9a54c9b service nova] Acquired lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-59d7f5ec-5cef-4340-b1b9-eabd10734e6f req-90e3d138-d35d-4957-bc19-5acaf9a54c9b service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Refreshing network info cache for port 8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Start _get_guest_xml network_info=[{"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:37:14 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:37:14 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-543439196',display_name='tempest-SnapshotDataIntegrityTests-server-543439196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-543439196',id=29,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+upLObjkOKNAUZLVX9BKr1a/UzxkWXka2UVRrkECUXvhP8OekoYOL3KnXUGir2rBIA+Xdsz297jDp5miKheavEy30g7F8YbVB5P9W4lp+cunnILKmhox+pVrsjFv8mEw==',key_name='tempest-keypair-1069791076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d778f501c55549db895391e5bb73dc26',ramdisk_id='',reservation_id='r-0km79jh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-511259500',owner_user_name='tempest-SnapshotDataIntegrityTests-511259500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c02a9118b9a4e388a81b388169fd773',uuid=0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Converting VIF {"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8106fcc8-1c86-4441-8f27-462700afb2f2,network=Network(981d36e9-479b-4d00-b0d0-438b47f0654d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8106fcc8-1c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.objects.instance [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:37:14 user nova-compute[75000]:   <uuid>0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb</uuid>
Nov 06 22:37:14 user nova-compute[75000]:   <name>instance-0000001d</name>
Nov 06 22:37:14 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:37:14 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:37:14 user nova-compute[75000]:   <metadata>
Nov 06 22:37:14 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:37:14 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:37:14 user nova-compute[75000]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-543439196</nova:name>
Nov 06 22:37:14 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:37:14</nova:creationTime>
Nov 06 22:37:14 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:37:14 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:37:14 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:37:14 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:37:14 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:37:14 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:37:14 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:37:14 user nova-compute[75000]:       <nova:owner>
Nov 06 22:37:14 user nova-compute[75000]:         <nova:user uuid="5c02a9118b9a4e388a81b388169fd773">tempest-SnapshotDataIntegrityTests-511259500-project-member</nova:user>
Nov 06 22:37:14 user nova-compute[75000]:         <nova:project uuid="d778f501c55549db895391e5bb73dc26">tempest-SnapshotDataIntegrityTests-511259500</nova:project>
Nov 06 22:37:14 user nova-compute[75000]:       </nova:owner>
Nov 06 22:37:14 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:37:14 user nova-compute[75000]:       <nova:ports>
Nov 06 22:37:14 user nova-compute[75000]:         <nova:port uuid="8106fcc8-1c86-4441-8f27-462700afb2f2">
Nov 06 22:37:14 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 22:37:14 user nova-compute[75000]:         </nova:port>
Nov 06 22:37:14 user nova-compute[75000]:       </nova:ports>
Nov 06 22:37:14 user nova-compute[75000]:     </nova:instance>
Nov 06 22:37:14 user nova-compute[75000]:   </metadata>
Nov 06 22:37:14 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:37:14 user nova-compute[75000]:     <system>
Nov 06 22:37:14 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:37:14 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:37:14 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:37:14 user nova-compute[75000]:       <entry name="serial">0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb</entry>
Nov 06 22:37:14 user nova-compute[75000]:       <entry name="uuid">0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb</entry>
Nov 06 22:37:14 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:37:14 user nova-compute[75000]:     </system>
Nov 06 22:37:14 user nova-compute[75000]:   </sysinfo>
Nov 06 22:37:14 user nova-compute[75000]:   <os>
Nov 06 22:37:14 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:37:14 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:37:14 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:37:14 user nova-compute[75000]:   </os>
Nov 06 22:37:14 user nova-compute[75000]:   <features>
Nov 06 22:37:14 user nova-compute[75000]:     <acpi/>
Nov 06 22:37:14 user nova-compute[75000]:     <apic/>
Nov 06 22:37:14 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:37:14 user nova-compute[75000]:   </features>
Nov 06 22:37:14 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:37:14 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:37:14 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:37:14 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:37:14 user nova-compute[75000]:   </clock>
Nov 06 22:37:14 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:37:14 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:37:14 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:37:14 user nova-compute[75000]:   </cpu>
Nov 06 22:37:14 user nova-compute[75000]:   <devices>
Nov 06 22:37:14 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:37:14 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:37:14 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk"/>
Nov 06 22:37:14 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:37:14 user nova-compute[75000]:     </disk>
Nov 06 22:37:14 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:37:14 user nova-compute[75000]:       <mac address="fa:16:3e:a2:a0:8b"/>
Nov 06 22:37:14 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:37:14 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:37:14 user nova-compute[75000]:       <target dev="tap8106fcc8-1c"/>
Nov 06 22:37:14 user nova-compute[75000]:     </interface>
Nov 06 22:37:14 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:37:14 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/console.log" append="off"/>
Nov 06 22:37:14 user nova-compute[75000]:     </serial>
Nov 06 22:37:14 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:37:14 user nova-compute[75000]:     <video>
Nov 06 22:37:14 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:37:14 user nova-compute[75000]:     </video>
Nov 06 22:37:14 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:37:14 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:37:14 user nova-compute[75000]:     </rng>
Nov 06 22:37:14 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:37:14 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:37:14 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:37:14 user nova-compute[75000]:     </memballoon>
Nov 06 22:37:14 user nova-compute[75000]:   </devices>
Nov 06 22:37:14 user nova-compute[75000]: </domain>
Nov 06 22:37:14 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-543439196',display_name='tempest-SnapshotDataIntegrityTests-server-543439196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-543439196',id=29,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+upLObjkOKNAUZLVX9BKr1a/UzxkWXka2UVRrkECUXvhP8OekoYOL3KnXUGir2rBIA+Xdsz297jDp5miKheavEy30g7F8YbVB5P9W4lp+cunnILKmhox+pVrsjFv8mEw==',key_name='tempest-keypair-1069791076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d778f501c55549db895391e5bb73dc26',ramdisk_id='',reservation_id='r-0km79jh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-511259500',owner_user_name='tempest-SnapshotDataIntegrityTests-511259500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c02a9118b9a4e388a81b388169fd773',uuid=0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Converting VIF {"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8106fcc8-1c86-4441-8f27-462700afb2f2,network=Network(981d36e9-479b-4d00-b0d0-438b47f0654d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8106fcc8-1c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG os_vif [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8106fcc8-1c86-4441-8f27-462700afb2f2,network=Network(981d36e9-479b-4d00-b0d0-438b47f0654d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8106fcc8-1c') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42a4ab77-de72-5521-a121-55abd5f9bc73', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8106fcc8-1c, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8106fcc8-1c, col_values=(('qos', UUID('ba2174ab-0190-4fb7-ad55-c6f292c5bf8d')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8106fcc8-1c, col_values=(('external_ids', {'iface-id': '8106fcc8-1c86-4441-8f27-462700afb2f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:a0:8b', 'vm-uuid': '0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:14 user nova-compute[75000]: INFO os_vif [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8106fcc8-1c86-4441-8f27-462700afb2f2,network=Network(981d36e9-479b-4d00-b0d0-438b47f0654d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8106fcc8-1c')
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:37:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No VIF found with MAC fa:16:3e:a2:a0:8b, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:37:15 user nova-compute[75000]: DEBUG nova.network.neutron [req-59d7f5ec-5cef-4340-b1b9-eabd10734e6f req-90e3d138-d35d-4957-bc19-5acaf9a54c9b service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updated VIF entry in instance network info cache for port 8106fcc8-1c86-4441-8f27-462700afb2f2. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:37:15 user nova-compute[75000]: DEBUG nova.network.neutron [req-59d7f5ec-5cef-4340-b1b9-eabd10734e6f req-90e3d138-d35d-4957-bc19-5acaf9a54c9b service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating instance_info_cache with network_info: [{"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59d7f5ec-5cef-4340-b1b9-eabd10734e6f req-90e3d138-d35d-4957-bc19-5acaf9a54c9b service nova] Releasing lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:37:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-9f28e860-05c0-4529-a72c-27485fb5a468 req-58b80348-058c-4ddf-b22d-99580779cc8a service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received event network-vif-plugged-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9f28e860-05c0-4529-a72c-27485fb5a468 req-58b80348-058c-4ddf-b22d-99580779cc8a service nova] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9f28e860-05c0-4529-a72c-27485fb5a468 req-58b80348-058c-4ddf-b22d-99580779cc8a service nova] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9f28e860-05c0-4529-a72c-27485fb5a468 req-58b80348-058c-4ddf-b22d-99580779cc8a service nova] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-9f28e860-05c0-4529-a72c-27485fb5a468 req-58b80348-058c-4ddf-b22d-99580779cc8a service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] No waiting events found dispatching network-vif-plugged-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:37:16 user nova-compute[75000]: WARNING nova.compute.manager [req-9f28e860-05c0-4529-a72c-27485fb5a468 req-58b80348-058c-4ddf-b22d-99580779cc8a service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received unexpected event network-vif-plugged-8106fcc8-1c86-4441-8f27-462700afb2f2 for instance with vm_state building and task_state spawning.
Nov 06 22:37:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:37:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Instance spawned successfully.
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:37:18 user nova-compute[75000]: INFO nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-b84aac5e-73a0-401a-9823-9aecb6f437dd req-dca86eb0-b895-4ff1-96f0-28d336678b8d service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received event network-vif-plugged-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b84aac5e-73a0-401a-9823-9aecb6f437dd req-dca86eb0-b895-4ff1-96f0-28d336678b8d service nova] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b84aac5e-73a0-401a-9823-9aecb6f437dd req-dca86eb0-b895-4ff1-96f0-28d336678b8d service nova] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b84aac5e-73a0-401a-9823-9aecb6f437dd req-dca86eb0-b895-4ff1-96f0-28d336678b8d service nova] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-b84aac5e-73a0-401a-9823-9aecb6f437dd req-dca86eb0-b895-4ff1-96f0-28d336678b8d service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] No waiting events found dispatching network-vif-plugged-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:37:18 user nova-compute[75000]: WARNING nova.compute.manager [req-b84aac5e-73a0-401a-9823-9aecb6f437dd req-dca86eb0-b895-4ff1-96f0-28d336678b8d service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received unexpected event network-vif-plugged-8106fcc8-1c86-4441-8f27-462700afb2f2 for instance with vm_state building and task_state spawning.
Nov 06 22:37:18 user nova-compute[75000]: INFO nova.compute.manager [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Took 6.64 seconds to build instance.
Nov 06 22:37:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2c4ec58f-64b6-4e4a-b5d9-4c9f21e0c246 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.740s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:20 user nova-compute[75000]: DEBUG nova.objects.instance [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:37:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquired lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:37:20 user nova-compute[75000]: DEBUG nova.network.neutron [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:37:20 user nova-compute[75000]: DEBUG nova.objects.instance [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'info_cache' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:20 user nova-compute[75000]: DEBUG nova.objects.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.network.neutron [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updating instance_info_cache with network_info: [{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Releasing lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:37:21 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance destroyed successfully.
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.objects.instance [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'resources' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.objects.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953138957',display_name='tempest-AttachVolumeTestJSON-server-1953138957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953138957',id=21,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKYUG+wX+Oy+5ZoCKABFPtVTS7CC7ezeu/QxRZrCFggdt3WxIBlw/f9Sjy6ccYGHltY5PMTkclfZi01PiCR7pnVT8WAyKEH2jdwmIpQmqFPlb4e6rSMVTU80G2v7DaTuQ==',key_name='tempest-keypair-458501348',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-r3alv0me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=16b393b8-83f7-4a36-9de2-f8c230c94be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_vif [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78f02e5b-8e, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c1f766a-00e9-43e1-a525-ebc6096c9edf) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:37:21 user nova-compute[75000]: INFO os_vif [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e')
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLuoRdnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:37:21 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26b54ff-f42f-41ba-aa87-7a18e8f8c02e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:37:21 user nova-compute[75000]: No targets found.
Nov 06 22:37:21 user nova-compute[75000]: iSNS:
Nov 06 22:37:21 user nova-compute[75000]: No targets found.
Nov 06 22:37:21 user nova-compute[75000]: STATIC:
Nov 06 22:37:21 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633
Nov 06 22:37:21 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:37:21 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:37:21 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363
Nov 06 22:37:21 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:37:21 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:37:21 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:37:21 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:37:21 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:37:21 user nova-compute[75000]: FIRMWARE:
Nov 06 22:37:21 user nova-compute[75000]: No targets found.
Nov 06 22:37:21 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:37:21 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:37:21 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[11930c83-1270-4c10-8d6c-cd99130b5d21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f57179-e63e-48cb-9f38-38285a25feea]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:37:21 user nova-compute[75000]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:37:21 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:37:21 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:37:21 user nova-compute[75000]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:37:21 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:37:21 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc296c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c1d642-74a9-4bf5-bf0a-cacdd4a2feaa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f51002-8f25-471f-865a-1be48ee28041]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a7b034-fcc5-40bd-af87-a7e5861da2cb]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffa72b4-3595-468b-bae7-a27aca11cf91]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b22aa5-a3d7-411a-811a-fe4457908281]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d60c98-35b1-4b0f-b11c-d0c629b84f5b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260]
Nov 06 22:37:21 user nova-compute[75000]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260] successful.
Nov 06 22:37:21 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436c771-bf6b-422a-8e33-b50235b9eff6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== disconnect_volume: return (333ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Start _get_guest_xml network_info=[{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLuoRdnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '16b393b8-83f7-4a36-9de2-f8c230c94be5', 'attached_at': '', 'detached_at': '', 'volume_id': 'e80316b8-80c9-4a48-824d-b1c11fa1e633', 'serial': 'e80316b8-80c9-4a48-824d-b1c11fa1e633'}, 'attachment_id': '182b29f4-63a1-47f2-951f-ec3a47059b79', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.objects.instance [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'numa_topology' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.objects.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:37:21 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:37:21 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.objects.instance [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.objects.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLuoRdnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:37:21 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:37:21 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:37:21 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c83b85f-4c58-4c9f-83e9-f4423a335e58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:37:21 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d7813-7cc6-4c5b-98d6-4956d3780e27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633] added
Nov 06 22:37:21 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d72030-dddb-4029-bd6c-4f08840f4b10]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7f419f-df93-41bb-8a16-c11cb0a19823]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLuoRdnU {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLuoRdnU" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abafd3c-37a3-4f1b-b03c-62a7ac635268]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TLuoRdnU'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7432e31e-24a8-4216-91f6-6f9c8070e8f4]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[213cd985-4cbd-4950-b5a8-1eccadbdc629]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea21091-a5c7-40b1-886f-4bbed9d8be98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260]
Nov 06 22:37:22 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260] successful.
Nov 06 22:37:22 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ad4f15-6234-4d2b-9204-21cd07a093b7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[881143e5-b84a-467b-b667-42f198051480]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:37:22 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a45790-a457-4146-add1-c143fc4696f2]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:37:22 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLuoRdnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23238356438643738', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238356438643738', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953138957',display_name='tempest-AttachVolumeTestJSON-server-1953138957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953138957',id=21,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKYUG+wX+Oy+5ZoCKABFPtVTS7CC7ezeu/QxRZrCFggdt3WxIBlw/f9Sjy6ccYGHltY5PMTkclfZi01PiCR7pnVT8WAyKEH2jdwmIpQmqFPlb4e6rSMVTU80G2v7DaTuQ==',key_name='tempest-keypair-458501348',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-r3alv0me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=16b393b8-83f7-4a36-9de2-f8c230c94be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.objects.instance [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'pci_devices' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.objects.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:37:23 user nova-compute[75000]:   <uuid>16b393b8-83f7-4a36-9de2-f8c230c94be5</uuid>
Nov 06 22:37:23 user nova-compute[75000]:   <name>instance-00000015</name>
Nov 06 22:37:23 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:37:23 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:37:23 user nova-compute[75000]:   <metadata>
Nov 06 22:37:23 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:37:23 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:37:23 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeTestJSON-server-1953138957</nova:name>
Nov 06 22:37:23 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:37:21</nova:creationTime>
Nov 06 22:37:23 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:37:23 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:37:23 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:37:23 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:37:23 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:37:23 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:37:23 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:37:23 user nova-compute[75000]:       <nova:owner>
Nov 06 22:37:23 user nova-compute[75000]:         <nova:user uuid="9adf42a2f6ae4b83900ab310933a6421">tempest-AttachVolumeTestJSON-738638018-project-member</nova:user>
Nov 06 22:37:23 user nova-compute[75000]:         <nova:project uuid="425b4940d7904d58982aae5a883fc3ed">tempest-AttachVolumeTestJSON-738638018</nova:project>
Nov 06 22:37:23 user nova-compute[75000]:       </nova:owner>
Nov 06 22:37:23 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:37:23 user nova-compute[75000]:       <nova:ports>
Nov 06 22:37:23 user nova-compute[75000]:         <nova:port uuid="78f02e5b-8e34-4d73-907b-c49095cc8147">
Nov 06 22:37:23 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:37:23 user nova-compute[75000]:         </nova:port>
Nov 06 22:37:23 user nova-compute[75000]:       </nova:ports>
Nov 06 22:37:23 user nova-compute[75000]:     </nova:instance>
Nov 06 22:37:23 user nova-compute[75000]:   </metadata>
Nov 06 22:37:23 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:37:23 user nova-compute[75000]:     <system>
Nov 06 22:37:23 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:37:23 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:37:23 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:37:23 user nova-compute[75000]:       <entry name="serial">16b393b8-83f7-4a36-9de2-f8c230c94be5</entry>
Nov 06 22:37:23 user nova-compute[75000]:       <entry name="uuid">16b393b8-83f7-4a36-9de2-f8c230c94be5</entry>
Nov 06 22:37:23 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:37:23 user nova-compute[75000]:     </system>
Nov 06 22:37:23 user nova-compute[75000]:   </sysinfo>
Nov 06 22:37:23 user nova-compute[75000]:   <os>
Nov 06 22:37:23 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:37:23 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:37:23 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:37:23 user nova-compute[75000]:   </os>
Nov 06 22:37:23 user nova-compute[75000]:   <features>
Nov 06 22:37:23 user nova-compute[75000]:     <acpi/>
Nov 06 22:37:23 user nova-compute[75000]:     <apic/>
Nov 06 22:37:23 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:37:23 user nova-compute[75000]:   </features>
Nov 06 22:37:23 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:37:23 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:37:23 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:37:23 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:37:23 user nova-compute[75000]:   </clock>
Nov 06 22:37:23 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:37:23 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:37:23 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:37:23 user nova-compute[75000]:   </cpu>
Nov 06 22:37:23 user nova-compute[75000]:   <devices>
Nov 06 22:37:23 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:37:23 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:37:23 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk"/>
Nov 06 22:37:23 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:37:23 user nova-compute[75000]:     </disk>
Nov 06 22:37:23 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:37:23 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:37:23 user nova-compute[75000]:       <source dev="/dev/sdc"/>
Nov 06 22:37:23 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:37:23 user nova-compute[75000]:       <serial>e80316b8-80c9-4a48-824d-b1c11fa1e633</serial>
Nov 06 22:37:23 user nova-compute[75000]:     </disk>
Nov 06 22:37:23 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:37:23 user nova-compute[75000]:       <mac address="fa:16:3e:a0:b0:4e"/>
Nov 06 22:37:23 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:37:23 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:37:23 user nova-compute[75000]:       <target dev="tap78f02e5b-8e"/>
Nov 06 22:37:23 user nova-compute[75000]:     </interface>
Nov 06 22:37:23 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:37:23 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/console.log" append="off"/>
Nov 06 22:37:23 user nova-compute[75000]:     </serial>
Nov 06 22:37:23 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:37:23 user nova-compute[75000]:     <video>
Nov 06 22:37:23 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:37:23 user nova-compute[75000]:     </video>
Nov 06 22:37:23 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:37:23 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:37:23 user nova-compute[75000]:     </rng>
Nov 06 22:37:23 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:37:23 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:37:23 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:37:23 user nova-compute[75000]:     </memballoon>
Nov 06 22:37:23 user nova-compute[75000]:   </devices>
Nov 06 22:37:23 user nova-compute[75000]: </domain>
Nov 06 22:37:23 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.objects.instance [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG nova.objects.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:37:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Cannot resize image /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG nova.objects.instance [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'migration_context' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG nova.objects.base [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953138957',display_name='tempest-AttachVolumeTestJSON-server-1953138957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953138957',id=21,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKYUG+wX+Oy+5ZoCKABFPtVTS7CC7ezeu/QxRZrCFggdt3WxIBlw/f9Sjy6ccYGHltY5PMTkclfZi01PiCR7pnVT8WAyKEH2jdwmIpQmqFPlb4e6rSMVTU80G2v7DaTuQ==',key_name='tempest-keypair-458501348',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-r3alv0me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=16b393b8-83f7-4a36-9de2-f8c230c94be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG os_vif [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '442fe7f0-a6f0-54e3-85ee-c3679aceb66c', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78f02e5b-8e, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78f02e5b-8e, col_values=(('qos', UUID('c17e7ece-a7c9-4834-a4e8-7441172e2a94')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78f02e5b-8e, col_values=(('external_ids', {'iface-id': '78f02e5b-8e34-4d73-907b-c49095cc8147', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:b0:4e', 'vm-uuid': '16b393b8-83f7-4a36-9de2-f8c230c94be5'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:37:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:24 user nova-compute[75000]: INFO os_vif [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e')
Nov 06 22:37:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-2d6c3bb3-e300-4e71-9961-5ae249933aca req-dc656091-1b47-4b28-be84-26ea26371b31 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2d6c3bb3-e300-4e71-9961-5ae249933aca req-dc656091-1b47-4b28-be84-26ea26371b31 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2d6c3bb3-e300-4e71-9961-5ae249933aca req-dc656091-1b47-4b28-be84-26ea26371b31 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.025s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2d6c3bb3-e300-4e71-9961-5ae249933aca req-dc656091-1b47-4b28-be84-26ea26371b31 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-2d6c3bb3-e300-4e71-9961-5ae249933aca req-dc656091-1b47-4b28-be84-26ea26371b31 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:37:25 user nova-compute[75000]: WARNING nova.compute.manager [req-2d6c3bb3-e300-4e71-9961-5ae249933aca req-dc656091-1b47-4b28-be84-26ea26371b31 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state stopped and task_state powering-on.
Nov 06 22:37:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG os_brick.utils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03e121c-d5dd-4ebd-aa11-e78d0b9b7bca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba612a2-e4fb-411b-89e9-c60474c354e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80596512-9041-42cb-ac0e-bbdc39940c37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a55471-6524-4bcc-868f-1ce8d8db89de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:37:26 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:37:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd57d1db-1985-4262-b877-a197a34f345b]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG os_brick.utils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:37:26 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Updating existing volume attachment record: f4416f45-a9fa-4f9d-9950-04832aaa8d12 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:37:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-257827e5-227e-4c7d-80ab-de5fd797dea2 req-450c50e6-a432-48db-ac4e-9877498ae325 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-257827e5-227e-4c7d-80ab-de5fd797dea2 req-450c50e6-a432-48db-ac4e-9877498ae325 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-257827e5-227e-4c7d-80ab-de5fd797dea2 req-450c50e6-a432-48db-ac4e-9877498ae325 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-257827e5-227e-4c7d-80ab-de5fd797dea2 req-450c50e6-a432-48db-ac4e-9877498ae325 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-257827e5-227e-4c7d-80ab-de5fd797dea2 req-450c50e6-a432-48db-ac4e-9877498ae325 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:37:28 user nova-compute[75000]: WARNING nova.compute.manager [req-257827e5-227e-4c7d-80ab-de5fd797dea2 req-450c50e6-a432-48db-ac4e-9877498ae325 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state stopped and task_state powering-on.
Nov 06 22:37:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:37:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance rebooted successfully.
Nov 06 22:37:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-996e16f5-0920-4325-8ac5-e81249162e33 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:37:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:32 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:32 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:37:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:38 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:37:38 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7317MB free_disk=25.00857162475586GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:38 user nova-compute[75000]: INFO nova.compute.manager [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Terminating instance
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0414d03a-aba0-44df-9cca-257ab81bde61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 3dfe6744-55ec-4294-8fda-5689879ed46b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0bd209e9-b6c8-4663-a443-77d251b3d802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c06fdcaf-015a-4f5e-9907-c95d1a775141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b06e5a39-e167-40c6-80a8-d70ca8e0ec7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c288d70-f095-4351-b88c-3fd44579fec0 req-1b78f90b-fcf3-4b49-9e57-93a974481607 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received event network-vif-unplugged-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c288d70-f095-4351-b88c-3fd44579fec0 req-1b78f90b-fcf3-4b49-9e57-93a974481607 service nova] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c288d70-f095-4351-b88c-3fd44579fec0 req-1b78f90b-fcf3-4b49-9e57-93a974481607 service nova] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c288d70-f095-4351-b88c-3fd44579fec0 req-1b78f90b-fcf3-4b49-9e57-93a974481607 service nova] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c288d70-f095-4351-b88c-3fd44579fec0 req-1b78f90b-fcf3-4b49-9e57-93a974481607 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] No waiting events found dispatching network-vif-unplugged-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c288d70-f095-4351-b88c-3fd44579fec0 req-1b78f90b-fcf3-4b49-9e57-93a974481607 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received event network-vif-unplugged-23d18ab8-4f29-4708-87c9-a59ce954842b for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.734s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Instance destroyed successfully.
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lazy-loading 'resources' on Instance uuid 0414d03a-aba0-44df-9cca-257ab81bde61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:31:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1466710765',display_name='tempest-VolumesAdminNegativeTest-server-1466710765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1466710765',id=17,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrGX8tG3p9W9zGWSEs9zG0jHwTfIA/HNN4ZMpvcNsHCx9hKf4YgFI7paE0lVIdB4qc1GcdcfeT2kcODfDd5VPpjS6emiEROsJx+ZrT+tGodvse3mtYHR6Npb0bMNCeONg==',key_name='tempest-keypair-1231136319',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:31:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='121f8a74b2de48a69627c6fc564d023f',ramdisk_id='',reservation_id='r-dct5doul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1947874717',owner_user_name='tempest-VolumesAdminNegativeTest-1947874717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:31:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f94a3ce27c483fabb4a3bcf053f141',uuid=0414d03a-aba0-44df-9cca-257ab81bde61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converting VIF {"id": "23d18ab8-4f29-4708-87c9-a59ce954842b", "address": "fa:16:3e:5d:6a:0d", "network": {"id": "ac4177fa-b580-4694-9c5b-d9842636a58d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1914482454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "121f8a74b2de48a69627c6fc564d023f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d18ab8-4f", "ovs_interfaceid": "23d18ab8-4f29-4708-87c9-a59ce954842b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=23d18ab8-4f29-4708-87c9-a59ce954842b,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d18ab8-4f') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG os_vif [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=23d18ab8-4f29-4708-87c9-a59ce954842b,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d18ab8-4f') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23d18ab8-4f, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09f85c73-c791-45fa-8a74-21e9d0234940) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:39 user nova-compute[75000]: INFO os_vif [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=23d18ab8-4f29-4708-87c9-a59ce954842b,network=Network(ac4177fa-b580-4694-9c5b-d9842636a58d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23d18ab8-4f')
Nov 06 22:37:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Deleting instance files /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61_del
Nov 06 22:37:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Deletion of /opt/stack/data/nova/instances/0414d03a-aba0-44df-9cca-257ab81bde61_del complete
Nov 06 22:37:39 user nova-compute[75000]: INFO nova.compute.manager [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 06 22:37:39 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:37:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:40 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:40 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:40 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:37:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:37:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:37:40 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-e99d7169-6c3b-410e-b547-ffba310aa236 req-ee711da1-f24d-4c2e-aa1b-861c68911e50 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received event network-vif-deleted-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:41 user nova-compute[75000]: INFO nova.compute.manager [req-e99d7169-6c3b-410e-b547-ffba310aa236 req-ee711da1-f24d-4c2e-aa1b-861c68911e50 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Neutron deleted interface 23d18ab8-4f29-4708-87c9-a59ce954842b; detaching it from the instance and deleting it from the info cache
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-e99d7169-6c3b-410e-b547-ffba310aa236 req-ee711da1-f24d-4c2e-aa1b-861c68911e50 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:41 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Took 1.44 seconds to deallocate network for instance.
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-efdf949b-5a0b-41b3-8b41-b43a322fdb90 req-42e3f280-a6fe-47e4-b36e-9a2473ed6272 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received event network-vif-plugged-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-efdf949b-5a0b-41b3-8b41-b43a322fdb90 req-42e3f280-a6fe-47e4-b36e-9a2473ed6272 service nova] Acquiring lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-efdf949b-5a0b-41b3-8b41-b43a322fdb90 req-42e3f280-a6fe-47e4-b36e-9a2473ed6272 service nova] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-efdf949b-5a0b-41b3-8b41-b43a322fdb90 req-42e3f280-a6fe-47e4-b36e-9a2473ed6272 service nova] Lock "0414d03a-aba0-44df-9cca-257ab81bde61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-efdf949b-5a0b-41b3-8b41-b43a322fdb90 req-42e3f280-a6fe-47e4-b36e-9a2473ed6272 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] No waiting events found dispatching network-vif-plugged-23d18ab8-4f29-4708-87c9-a59ce954842b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:37:41 user nova-compute[75000]: WARNING nova.compute.manager [req-efdf949b-5a0b-41b3-8b41-b43a322fdb90 req-42e3f280-a6fe-47e4-b36e-9a2473ed6272 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Received unexpected event network-vif-plugged-23d18ab8-4f29-4708-87c9-a59ce954842b for instance with vm_state active and task_state deleting.
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-e99d7169-6c3b-410e-b547-ffba310aa236 req-ee711da1-f24d-4c2e-aa1b-861c68911e50 service nova] [instance: 0414d03a-aba0-44df-9cca-257ab81bde61] Detach interface failed, port_id=23d18ab8-4f29-4708-87c9-a59ce954842b, reason: Instance 0414d03a-aba0-44df-9cca-257ab81bde61 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updating instance_info_cache with network_info: [{"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:41 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Deleted allocations for instance 0414d03a-aba0-44df-9cca-257ab81bde61
Nov 06 22:37:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-950b1da8-2f4a-4e40-81cc-4dd9b8c4d567 tempest-VolumesAdminNegativeTest-1947874717 tempest-VolumesAdminNegativeTest-1947874717-project-member] Lock "0414d03a-aba0-44df-9cca-257ab81bde61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.194s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-c1607257-16a7-470b-89ac-2401d839eadb req-2288ee0f-29ba-4d43-82c9-788fd76874cc service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received event network-changed-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:37:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-c1607257-16a7-470b-89ac-2401d839eadb req-2288ee0f-29ba-4d43-82c9-788fd76874cc service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Refreshing instance network info cache due to event network-changed-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:37:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c1607257-16a7-470b-89ac-2401d839eadb req-2288ee0f-29ba-4d43-82c9-788fd76874cc service nova] Acquiring lock "refresh_cache-c06fdcaf-015a-4f5e-9907-c95d1a775141" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:37:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c1607257-16a7-470b-89ac-2401d839eadb req-2288ee0f-29ba-4d43-82c9-788fd76874cc service nova] Acquired lock "refresh_cache-c06fdcaf-015a-4f5e-9907-c95d1a775141" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:37:47 user nova-compute[75000]: DEBUG nova.network.neutron [req-c1607257-16a7-470b-89ac-2401d839eadb req-2288ee0f-29ba-4d43-82c9-788fd76874cc service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Refreshing network info cache for port 26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:37:48 user nova-compute[75000]: DEBUG nova.network.neutron [req-c1607257-16a7-470b-89ac-2401d839eadb req-2288ee0f-29ba-4d43-82c9-788fd76874cc service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Updated VIF entry in instance network info cache for port 26e57c36-87d2-49f8-9d8b-1d3436e3a7d0. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:37:48 user nova-compute[75000]: DEBUG nova.network.neutron [req-c1607257-16a7-470b-89ac-2401d839eadb req-2288ee0f-29ba-4d43-82c9-788fd76874cc service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Updating instance_info_cache with network_info: [{"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:37:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c1607257-16a7-470b-89ac-2401d839eadb req-2288ee0f-29ba-4d43-82c9-788fd76874cc service nova] Releasing lock "refresh_cache-c06fdcaf-015a-4f5e-9907-c95d1a775141" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:37:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:53 user nova-compute[75000]: DEBUG nova.objects.instance [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'flavor' on Instance uuid c06fdcaf-015a-4f5e-9907-c95d1a775141 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:37:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:37:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:37:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:37:53 user nova-compute[75000]: INFO nova.compute.manager [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Attaching volume f3f91e9f-303a-4569-893e-656bcd5dc075 to /dev/vdb
Nov 06 22:37:54 user nova-compute[75000]: DEBUG os_brick.utils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[792070f2-c0bc-476f-91a8-34b5aca35c7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaacf09-aeee-41e9-9983-75fcd5c5b039]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[044e94c0-df7c-418c-8528-61eaf8ba2dda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34b5367-4c31-4ac8-9be3-390528c66943]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:37:54 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:37:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6d6d7-0ae6-44b5-b53f-a0658bc3fde3]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG os_brick.utils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Updating existing volume attachment record: 4af445e9-8506-4eb9-b409-cb2016534f6a {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:37:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:37:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:38:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:38:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:38:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:38:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrOJBzxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:38:17 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:38:17 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:38:17 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f539457-e0fc-4488-8e00-d659b94f06dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:38:17 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[437ad8cd-497e-451a-834f-681b945b7184]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075] added
Nov 06 22:38:17 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39f81a9-6a14-4a65-9526-df1352018834]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[852f1347-40f1-4152-912f-4b13df421829]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrOJBzxI {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrOJBzxI" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5146a1dc-45a6-4740-81f8-bb2c68e0ba75]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrOJBzxI'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57afbfc-5ffd-44d4-8cbb-e93b830ac35d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9164e03-f879-41f6-9406-c952310660cc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:17 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:17 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:17 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:17 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:17 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:17 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:38:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f0d79c-b3a8-4854-b83b-c79ad3670d32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075, portal: 172.16.0.220,3260]
Nov 06 22:38:18 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075, portal: 172.16.0.220,3260] successful.
Nov 06 22:38:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6879657-a3d4-4163-88c7-5e3cd3f0924f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f173f792-812d-441f-b825-420aa3b012f9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:18 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:18 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:18 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:18 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:18 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:18 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5718b9-9cb2-441a-9bf1-b922673d7e6b]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:38:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrOJBzxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23166356166336639', 'path': '/dev/sde'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166356166336639', 'path': '/dev/sde'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG nova.objects.instance [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'flavor' on Instance uuid c06fdcaf-015a-4f5e-9907-c95d1a775141 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:38:19 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:38:19 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:38:19 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:38:19 user nova-compute[75000]:   <serial>f3f91e9f-303a-4569-893e-656bcd5dc075</serial>
Nov 06 22:38:19 user nova-compute[75000]: </disk>
Nov 06 22:38:19 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No VIF found with MAC fa:16:3e:48:51:e5, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d11b1bc4-3e1e-4427-bb19-54a2b928c246 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.828s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:20 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:38:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:20 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:38:20 user nova-compute[75000]: INFO nova.compute.claims [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Claim successful on node user
Nov 06 22:38:21 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:38:21 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:38:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG nova.policy [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd288b4ec7d714054aefff906d8070a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c00b052f634d689bfa3e28ffce3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:38:21 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Creating image(s)
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "/opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "/opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk 1073741824" returned: 0 in 0.056s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Successfully created port: 65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.210s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Cannot resize image /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Ensure instance console log exists: /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Successfully updated port: 65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "refresh_cache-fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquired lock "refresh_cache-fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-d44d5974-ed87-4454-bccd-f5dea296a2e5 req-07b2835e-38db-47e1-9ac5-30462730d699 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received event network-changed-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-d44d5974-ed87-4454-bccd-f5dea296a2e5 req-07b2835e-38db-47e1-9ac5-30462730d699 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Refreshing instance network info cache due to event network-changed-65b301c5-8c5d-4f69-9664-ec9fa0df1f58. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d44d5974-ed87-4454-bccd-f5dea296a2e5 req-07b2835e-38db-47e1-9ac5-30462730d699 service nova] Acquiring lock "refresh_cache-fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:38:22 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Updating instance_info_cache with network_info: [{"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Releasing lock "refresh_cache-fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Instance network_info: |[{"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d44d5974-ed87-4454-bccd-f5dea296a2e5 req-07b2835e-38db-47e1-9ac5-30462730d699 service nova] Acquired lock "refresh_cache-fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-d44d5974-ed87-4454-bccd-f5dea296a2e5 req-07b2835e-38db-47e1-9ac5-30462730d699 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Refreshing network info cache for port 65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Start _get_guest_xml network_info=[{"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "28438841-a940-4f76-ac21-2ec0a70bf6d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:23 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:23 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-916804623',display_name='tempest-VolumesSnapshotTestJSON-instance-916804623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-916804623',id=30,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2W1yzz96c0Zcv2mfg3KJTAsEI8lhsEv4wVfBZ621roHpP5WVj1ph6QkyWmrGNp0IfYN/lQMuC5kOCD5kWPwOXUB9IVdMCV78YHYj4QgyguA1r+MvJnOd8C4D2xNrFHWA==',key_name='tempest-keypair-88670871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c00b052f634d689bfa3e28ffce3d95',ramdisk_id='',reservation_id='r-orzimbxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-549753594',owner_user_name='tempest-VolumesSnapshotTestJSON-549753594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d288b4ec7d714054aefff906d8070a5d',uuid=fd2235fd-3b64-4ff2-8350-aa3a9b092ecd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converting VIF {"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:ec:20,bridge_name='br-int',has_traffic_filtering=True,id=65b301c5-8c5d-4f69-9664-ec9fa0df1f58,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b301c5-8c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.objects.instance [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'pci_devices' on Instance uuid fd2235fd-3b64-4ff2-8350-aa3a9b092ecd {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:38:23 user nova-compute[75000]:   <uuid>fd2235fd-3b64-4ff2-8350-aa3a9b092ecd</uuid>
Nov 06 22:38:23 user nova-compute[75000]:   <name>instance-0000001e</name>
Nov 06 22:38:23 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:38:23 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:38:23 user nova-compute[75000]:   <metadata>
Nov 06 22:38:23 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:38:23 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:38:23 user nova-compute[75000]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-916804623</nova:name>
Nov 06 22:38:23 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:38:23</nova:creationTime>
Nov 06 22:38:23 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:38:23 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:38:23 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:38:23 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:38:23 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:38:23 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:38:23 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:38:23 user nova-compute[75000]:       <nova:owner>
Nov 06 22:38:23 user nova-compute[75000]:         <nova:user uuid="d288b4ec7d714054aefff906d8070a5d">tempest-VolumesSnapshotTestJSON-549753594-project-member</nova:user>
Nov 06 22:38:23 user nova-compute[75000]:         <nova:project uuid="85c00b052f634d689bfa3e28ffce3d95">tempest-VolumesSnapshotTestJSON-549753594</nova:project>
Nov 06 22:38:23 user nova-compute[75000]:       </nova:owner>
Nov 06 22:38:23 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:38:23 user nova-compute[75000]:       <nova:ports>
Nov 06 22:38:23 user nova-compute[75000]:         <nova:port uuid="65b301c5-8c5d-4f69-9664-ec9fa0df1f58">
Nov 06 22:38:23 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 22:38:23 user nova-compute[75000]:         </nova:port>
Nov 06 22:38:23 user nova-compute[75000]:       </nova:ports>
Nov 06 22:38:23 user nova-compute[75000]:     </nova:instance>
Nov 06 22:38:23 user nova-compute[75000]:   </metadata>
Nov 06 22:38:23 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:38:23 user nova-compute[75000]:     <system>
Nov 06 22:38:23 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:38:23 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:38:23 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:38:23 user nova-compute[75000]:       <entry name="serial">fd2235fd-3b64-4ff2-8350-aa3a9b092ecd</entry>
Nov 06 22:38:23 user nova-compute[75000]:       <entry name="uuid">fd2235fd-3b64-4ff2-8350-aa3a9b092ecd</entry>
Nov 06 22:38:23 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:38:23 user nova-compute[75000]:     </system>
Nov 06 22:38:23 user nova-compute[75000]:   </sysinfo>
Nov 06 22:38:23 user nova-compute[75000]:   <os>
Nov 06 22:38:23 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:38:23 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:38:23 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:38:23 user nova-compute[75000]:   </os>
Nov 06 22:38:23 user nova-compute[75000]:   <features>
Nov 06 22:38:23 user nova-compute[75000]:     <acpi/>
Nov 06 22:38:23 user nova-compute[75000]:     <apic/>
Nov 06 22:38:23 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:38:23 user nova-compute[75000]:   </features>
Nov 06 22:38:23 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:38:23 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:38:23 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:38:23 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:38:23 user nova-compute[75000]:   </clock>
Nov 06 22:38:23 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:38:23 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:38:23 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:38:23 user nova-compute[75000]:   </cpu>
Nov 06 22:38:23 user nova-compute[75000]:   <devices>
Nov 06 22:38:23 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:38:23 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:38:23 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk"/>
Nov 06 22:38:23 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:38:23 user nova-compute[75000]:     </disk>
Nov 06 22:38:23 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:38:23 user nova-compute[75000]:       <mac address="fa:16:3e:47:ec:20"/>
Nov 06 22:38:23 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:38:23 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:38:23 user nova-compute[75000]:       <target dev="tap65b301c5-8c"/>
Nov 06 22:38:23 user nova-compute[75000]:     </interface>
Nov 06 22:38:23 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:38:23 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/console.log" append="off"/>
Nov 06 22:38:23 user nova-compute[75000]:     </serial>
Nov 06 22:38:23 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:38:23 user nova-compute[75000]:     <video>
Nov 06 22:38:23 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:38:23 user nova-compute[75000]:     </video>
Nov 06 22:38:23 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:38:23 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:38:23 user nova-compute[75000]:     </rng>
Nov 06 22:38:23 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:38:23 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:38:23 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:38:23 user nova-compute[75000]:     </memballoon>
Nov 06 22:38:23 user nova-compute[75000]:   </devices>
Nov 06 22:38:23 user nova-compute[75000]: </domain>
Nov 06 22:38:23 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-916804623',display_name='tempest-VolumesSnapshotTestJSON-instance-916804623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-916804623',id=30,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2W1yzz96c0Zcv2mfg3KJTAsEI8lhsEv4wVfBZ621roHpP5WVj1ph6QkyWmrGNp0IfYN/lQMuC5kOCD5kWPwOXUB9IVdMCV78YHYj4QgyguA1r+MvJnOd8C4D2xNrFHWA==',key_name='tempest-keypair-88670871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c00b052f634d689bfa3e28ffce3d95',ramdisk_id='',reservation_id='r-orzimbxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-549753594',owner_user_name='tempest-VolumesSnapshotTestJSON-549753594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d288b4ec7d714054aefff906d8070a5d',uuid=fd2235fd-3b64-4ff2-8350-aa3a9b092ecd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converting VIF {"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:ec:20,bridge_name='br-int',has_traffic_filtering=True,id=65b301c5-8c5d-4f69-9664-ec9fa0df1f58,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b301c5-8c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG os_vif [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:ec:20,bridge_name='br-int',has_traffic_filtering=True,id=65b301c5-8c5d-4f69-9664-ec9fa0df1f58,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b301c5-8c') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77c16477-8c8c-5a3f-a1c7-f6e47280b702', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65b301c5-8c, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65b301c5-8c, col_values=(('qos', UUID('5b037ed7-30b6-4390-9c1b-e8e00decb881')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65b301c5-8c, col_values=(('external_ids', {'iface-id': '65b301c5-8c5d-4f69-9664-ec9fa0df1f58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:ec:20', 'vm-uuid': 'fd2235fd-3b64-4ff2-8350-aa3a9b092ecd'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:23 user nova-compute[75000]: INFO os_vif [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:ec:20,bridge_name='br-int',has_traffic_filtering=True,id=65b301c5-8c5d-4f69-9664-ec9fa0df1f58,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b301c5-8c')
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No VIF found with MAC fa:16:3e:47:ec:20, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:38:23 user nova-compute[75000]: INFO nova.compute.claims [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Claim successful on node user
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-d44d5974-ed87-4454-bccd-f5dea296a2e5 req-07b2835e-38db-47e1-9ac5-30462730d699 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Updated VIF entry in instance network info cache for port 65b301c5-8c5d-4f69-9664-ec9fa0df1f58. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-d44d5974-ed87-4454-bccd-f5dea296a2e5 req-07b2835e-38db-47e1-9ac5-30462730d699 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Updating instance_info_cache with network_info: [{"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:38:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d44d5974-ed87-4454-bccd-f5dea296a2e5 req-07b2835e-38db-47e1-9ac5-30462730d699 service nova] Releasing lock "refresh_cache-fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.787s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG nova.network.neutron [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:38:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:38:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG nova.policy [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33f333b132a1474d983798ab0642b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf4f6360f6c486ab24087a20da8b6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:38:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Creating image(s)
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "/opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "/opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "/opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk 1073741824" returned: 0 in 0.064s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-09f35cfa-2de7-461e-9705-a6a683fc42b5 req-4ba05630-3eb7-42ee-a5a0-573a7761e9dc service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received event network-vif-plugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-09f35cfa-2de7-461e-9705-a6a683fc42b5 req-4ba05630-3eb7-42ee-a5a0-573a7761e9dc service nova] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-09f35cfa-2de7-461e-9705-a6a683fc42b5 req-4ba05630-3eb7-42ee-a5a0-573a7761e9dc service nova] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-09f35cfa-2de7-461e-9705-a6a683fc42b5 req-4ba05630-3eb7-42ee-a5a0-573a7761e9dc service nova] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-09f35cfa-2de7-461e-9705-a6a683fc42b5 req-4ba05630-3eb7-42ee-a5a0-573a7761e9dc service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] No waiting events found dispatching network-vif-plugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:25 user nova-compute[75000]: WARNING nova.compute.manager [req-09f35cfa-2de7-461e-9705-a6a683fc42b5 req-4ba05630-3eb7-42ee-a5a0-573a7761e9dc service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received unexpected event network-vif-plugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 for instance with vm_state building and task_state spawning.
Nov 06 22:38:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG nova.network.neutron [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Successfully created port: f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Cannot resize image /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Ensure instance console log exists: /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Successfully updated port: f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "refresh_cache-28438841-a940-4f76-ac21-2ec0a70bf6d9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquired lock "refresh_cache-28438841-a940-4f76-ac21-2ec0a70bf6d9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-0c785489-4181-4807-9f78-5a6a36fe6be9 req-cc5d5228-ec4e-4ec4-af9f-fbf20badedfc service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received event network-changed-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-0c785489-4181-4807-9f78-5a6a36fe6be9 req-cc5d5228-ec4e-4ec4-af9f-fbf20badedfc service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Refreshing instance network info cache due to event network-changed-f83d494a-02a3-4d33-bd92-891fc7a84497. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0c785489-4181-4807-9f78-5a6a36fe6be9 req-cc5d5228-ec4e-4ec4-af9f-fbf20badedfc service nova] Acquiring lock "refresh_cache-28438841-a940-4f76-ac21-2ec0a70bf6d9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Updating instance_info_cache with network_info: [{"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Releasing lock "refresh_cache-28438841-a940-4f76-ac21-2ec0a70bf6d9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Instance network_info: |[{"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0c785489-4181-4807-9f78-5a6a36fe6be9 req-cc5d5228-ec4e-4ec4-af9f-fbf20badedfc service nova] Acquired lock "refresh_cache-28438841-a940-4f76-ac21-2ec0a70bf6d9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.neutron [req-0c785489-4181-4807-9f78-5a6a36fe6be9 req-cc5d5228-ec4e-4ec4-af9f-fbf20badedfc service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Refreshing network info cache for port f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Start _get_guest_xml network_info=[{"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:38:26 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:26 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2124686249',display_name='tempest-AttachVolumeNegativeTest-server-2124686249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2124686249',id=31,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOzU+TPLf7JQh+fj25jZUVGhCXW4qC1fLzWJjsr87Vk/06p7X0DFkWPceRuK2Vz/IzeIP3Qvw2p2xZW5VabJwJMQvltt0BxuKmxugXtKil9Dw8OrOljElDvxSS633g9tg==',key_name='tempest-keypair-477476533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-308r72q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=28438841-a940-4f76-ac21-2ec0a70bf6d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d1:33,bridge_name='br-int',has_traffic_filtering=True,id=f83d494a-02a3-4d33-bd92-891fc7a84497,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d494a-02') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'pci_devices' on Instance uuid 28438841-a940-4f76-ac21-2ec0a70bf6d9 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:38:26 user nova-compute[75000]:   <uuid>28438841-a940-4f76-ac21-2ec0a70bf6d9</uuid>
Nov 06 22:38:26 user nova-compute[75000]:   <name>instance-0000001f</name>
Nov 06 22:38:26 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:38:26 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:38:26 user nova-compute[75000]:   <metadata>
Nov 06 22:38:26 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:38:26 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:38:26 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2124686249</nova:name>
Nov 06 22:38:26 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:38:26</nova:creationTime>
Nov 06 22:38:26 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:38:26 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:38:26 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:38:26 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:38:26 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:38:26 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:38:26 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:38:26 user nova-compute[75000]:       <nova:owner>
Nov 06 22:38:26 user nova-compute[75000]:         <nova:user uuid="33f333b132a1474d983798ab0642b053">tempest-AttachVolumeNegativeTest-90304964-project-member</nova:user>
Nov 06 22:38:26 user nova-compute[75000]:         <nova:project uuid="0cf4f6360f6c486ab24087a20da8b6cb">tempest-AttachVolumeNegativeTest-90304964</nova:project>
Nov 06 22:38:26 user nova-compute[75000]:       </nova:owner>
Nov 06 22:38:26 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:38:26 user nova-compute[75000]:       <nova:ports>
Nov 06 22:38:26 user nova-compute[75000]:         <nova:port uuid="f83d494a-02a3-4d33-bd92-891fc7a84497">
Nov 06 22:38:26 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 22:38:26 user nova-compute[75000]:         </nova:port>
Nov 06 22:38:26 user nova-compute[75000]:       </nova:ports>
Nov 06 22:38:26 user nova-compute[75000]:     </nova:instance>
Nov 06 22:38:26 user nova-compute[75000]:   </metadata>
Nov 06 22:38:26 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:38:26 user nova-compute[75000]:     <system>
Nov 06 22:38:26 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:38:26 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:38:26 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:38:26 user nova-compute[75000]:       <entry name="serial">28438841-a940-4f76-ac21-2ec0a70bf6d9</entry>
Nov 06 22:38:26 user nova-compute[75000]:       <entry name="uuid">28438841-a940-4f76-ac21-2ec0a70bf6d9</entry>
Nov 06 22:38:26 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:38:26 user nova-compute[75000]:     </system>
Nov 06 22:38:26 user nova-compute[75000]:   </sysinfo>
Nov 06 22:38:26 user nova-compute[75000]:   <os>
Nov 06 22:38:26 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:38:26 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:38:26 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:38:26 user nova-compute[75000]:   </os>
Nov 06 22:38:26 user nova-compute[75000]:   <features>
Nov 06 22:38:26 user nova-compute[75000]:     <acpi/>
Nov 06 22:38:26 user nova-compute[75000]:     <apic/>
Nov 06 22:38:26 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:38:26 user nova-compute[75000]:   </features>
Nov 06 22:38:26 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:38:26 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:38:26 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:38:26 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:38:26 user nova-compute[75000]:   </clock>
Nov 06 22:38:26 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:38:26 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:38:26 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:38:26 user nova-compute[75000]:   </cpu>
Nov 06 22:38:26 user nova-compute[75000]:   <devices>
Nov 06 22:38:26 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:38:26 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:38:26 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk"/>
Nov 06 22:38:26 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:38:26 user nova-compute[75000]:     </disk>
Nov 06 22:38:26 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:38:26 user nova-compute[75000]:       <mac address="fa:16:3e:e7:d1:33"/>
Nov 06 22:38:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:38:26 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:38:26 user nova-compute[75000]:       <target dev="tapf83d494a-02"/>
Nov 06 22:38:26 user nova-compute[75000]:     </interface>
Nov 06 22:38:26 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:38:26 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/console.log" append="off"/>
Nov 06 22:38:26 user nova-compute[75000]:     </serial>
Nov 06 22:38:26 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:38:26 user nova-compute[75000]:     <video>
Nov 06 22:38:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:38:26 user nova-compute[75000]:     </video>
Nov 06 22:38:26 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:38:26 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:38:26 user nova-compute[75000]:     </rng>
Nov 06 22:38:26 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:38:26 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:38:26 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:38:26 user nova-compute[75000]:     </memballoon>
Nov 06 22:38:26 user nova-compute[75000]:   </devices>
Nov 06 22:38:26 user nova-compute[75000]: </domain>
Nov 06 22:38:26 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2124686249',display_name='tempest-AttachVolumeNegativeTest-server-2124686249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2124686249',id=31,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOzU+TPLf7JQh+fj25jZUVGhCXW4qC1fLzWJjsr87Vk/06p7X0DFkWPceRuK2Vz/IzeIP3Qvw2p2xZW5VabJwJMQvltt0BxuKmxugXtKil9Dw8OrOljElDvxSS633g9tg==',key_name='tempest-keypair-477476533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-308r72q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=28438841-a940-4f76-ac21-2ec0a70bf6d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d1:33,bridge_name='br-int',has_traffic_filtering=True,id=f83d494a-02a3-4d33-bd92-891fc7a84497,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d494a-02') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG os_vif [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d1:33,bridge_name='br-int',has_traffic_filtering=True,id=f83d494a-02a3-4d33-bd92-891fc7a84497,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d494a-02') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d954278-d6f4-5a29-a78f-4d90b7fe3213', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf83d494a-02, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf83d494a-02, col_values=(('qos', UUID('5f296467-60e2-4038-bd14-8613673b9496')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf83d494a-02, col_values=(('external_ids', {'iface-id': 'f83d494a-02a3-4d33-bd92-891fc7a84497', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:d1:33', 'vm-uuid': '28438841-a940-4f76-ac21-2ec0a70bf6d9'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:26 user nova-compute[75000]: INFO os_vif [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d1:33,bridge_name='br-int',has_traffic_filtering=True,id=f83d494a-02a3-4d33-bd92-891fc7a84497,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d494a-02')
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No VIF found with MAC fa:16:3e:e7:d1:33, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.neutron [req-0c785489-4181-4807-9f78-5a6a36fe6be9 req-cc5d5228-ec4e-4ec4-af9f-fbf20badedfc service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Updated VIF entry in instance network info cache for port f83d494a-02a3-4d33-bd92-891fc7a84497. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.network.neutron [req-0c785489-4181-4807-9f78-5a6a36fe6be9 req-cc5d5228-ec4e-4ec4-af9f-fbf20badedfc service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Updating instance_info_cache with network_info: [{"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXZLsncI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:38:26 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:38:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:38:26 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:38:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:38:26 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0c785489-4181-4807-9f78-5a6a36fe6be9 req-cc5d5228-ec4e-4ec4-af9f-fbf20badedfc service nova] Releasing lock "refresh_cache-28438841-a940-4f76-ac21-2ec0a70bf6d9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea8340-0ffc-4dc7-aa6e-55449eebd3e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:38:26 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:38:26 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Instance spawned successfully.
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d58036c-b185-4448-a222-6e469568fe3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4] added
Nov 06 22:38:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b10711-817f-41f3-95db-11c6cf405553]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36079bd1-1156-439f-ba09-deacc38497bf]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JXZLsncI {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JXZLsncI" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23c4558-9ef1-4aa7-89e5-2092ea9079eb]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JXZLsncI'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:27 user nova-compute[75000]: INFO nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[064a1d0b-3f80-4739-8abf-cc2861ac79c4]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:38:27 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Creating image(s)
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Ensure instance console log exists: /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Start _get_guest_xml network_info=[{"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyuWThg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b06e5a39-e167-40c6-80a8-d70ca8e0ec7f', 'attached_at': '', 'detached_at': '', 'volume_id': '9a4f063c-96fc-4297-84ff-81acd181ad5f', 'serial': '9a4f063c-96fc-4297-84ff-81acd181ad5f'}, 'attachment_id': 'f4416f45-a9fa-4f9d-9950-04832aaa8d12', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ab228-91b6-4a4f-9bcb-be71cb2e623f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:27 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:27 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyuWThg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:38:27 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:38:27 user nova-compute[75000]: INFO nova.compute.manager [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Took 6.71 seconds to build instance.
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[330a3275-dc1f-42ac-8cf6-9af913b9e84d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4, portal: 172.16.0.220,3260]
Nov 06 22:38:27 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4, portal: 172.16.0.220,3260] successful.
Nov 06 22:38:27 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.compute.manager [req-12141071-79ab-4d7a-855c-3dc1e4aef912 req-ca23bf2c-d070-4753-90ab-95ba00a6b13b service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received event network-vif-plugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-12141071-79ab-4d7a-855c-3dc1e4aef912 req-ca23bf2c-d070-4753-90ab-95ba00a6b13b service nova] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-12141071-79ab-4d7a-855c-3dc1e4aef912 req-ca23bf2c-d070-4753-90ab-95ba00a6b13b service nova] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-12141071-79ab-4d7a-855c-3dc1e4aef912 req-ca23bf2c-d070-4753-90ab-95ba00a6b13b service nova] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.compute.manager [req-12141071-79ab-4d7a-855c-3dc1e4aef912 req-ca23bf2c-d070-4753-90ab-95ba00a6b13b service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] No waiting events found dispatching network-vif-plugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:27 user nova-compute[75000]: WARNING nova.compute.manager [req-12141071-79ab-4d7a-855c-3dc1e4aef912 req-ca23bf2c-d070-4753-90ab-95ba00a6b13b service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received unexpected event network-vif-plugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 for instance with vm_state active and task_state None.
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f651aeb-c26e-46de-bf2f-6adf4f2c62a1 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.834s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7edd3c-42ec-45ae-8ec7-d42ec35219f4]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[57accad3-bc7a-416c-9418-365791900405]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:27 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6376b94e-bce7-43c1-bae7-be23fbcad7fe]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXZLsncI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:38:27 user nova-compute[75000]: INFO nova.compute.manager [None req-efaa8b99-243e-46ff-a994-3ee6f81e3c95 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Unrescuing
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efaa8b99-243e-46ff-a994-3ee6f81e3c95 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efaa8b99-243e-46ff-a994-3ee6f81e3c95 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquired lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:38:27 user nova-compute[75000]: DEBUG nova.network.neutron [None req-efaa8b99-243e-46ff-a994-3ee6f81e3c95 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:38:28 user nova-compute[75000]: INFO nova.compute.claims [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Claim successful on node user
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23031623762373237', 'path': '/dev/sdf'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031623762373237', 'path': '/dev/sdf'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.123s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:38:28 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:38:28 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.objects.instance [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lazy-loading 'flavor' on Instance uuid 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-df466dff-34bd-43d5-808f-c99ac1826f9a req-a0418d64-1931-4f95-a0ef-c4651c2cb2e9 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received event network-vif-plugged-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-df466dff-34bd-43d5-808f-c99ac1826f9a req-a0418d64-1931-4f95-a0ef-c4651c2cb2e9 service nova] Acquiring lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-df466dff-34bd-43d5-808f-c99ac1826f9a req-a0418d64-1931-4f95-a0ef-c4651c2cb2e9 service nova] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-df466dff-34bd-43d5-808f-c99ac1826f9a req-a0418d64-1931-4f95-a0ef-c4651c2cb2e9 service nova] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-df466dff-34bd-43d5-808f-c99ac1826f9a req-a0418d64-1931-4f95-a0ef-c4651c2cb2e9 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] No waiting events found dispatching network-vif-plugged-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:28 user nova-compute[75000]: WARNING nova.compute.manager [req-df466dff-34bd-43d5-808f-c99ac1826f9a req-a0418d64-1931-4f95-a0ef-c4651c2cb2e9 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received unexpected event network-vif-plugged-f83d494a-02a3-4d33-bd92-891fc7a84497 for instance with vm_state building and task_state spawning.
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e286c8c-753f-4185-8b99-1c0f652fe246]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:38:28 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:38:28 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:38:28 user nova-compute[75000]:   <source dev="/dev/sdf"/>
Nov 06 22:38:28 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:38:28 user nova-compute[75000]:   <serial>b71d212c-c8c9-49a4-9f55-9c38d90a45f4</serial>
Nov 06 22:38:28 user nova-compute[75000]: </disk>
Nov 06 22:38:28 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1e7f88-4a44-47bf-a4a2-647e7de9fa7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f] added
Nov 06 22:38:28 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[172faaa1-e9ed-4e4b-970e-b7ce0fd55cc6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96566d3f-3c85-43c8-b898-4d6e25a62b95]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGyuWThg {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGyuWThg" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21766e4-db83-4166-9047-221b3c1b8d0a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HGyuWThg'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b29e36-654c-4766-87b6-7ffce8bac781]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.network.neutron [None req-efaa8b99-243e-46ff-a994-3ee6f81e3c95 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updating instance_info_cache with network_info: [{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b390ac9-8ec2-4570-9749-9949a30f2430]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-efaa8b99-243e-46ff-a994-3ee6f81e3c95 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Releasing lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.objects.instance [None req-efaa8b99-243e-46ff-a994-3ee6f81e3c95 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'flavor' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6fd783-eb22-4354-b03e-df1403c0a286]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f, portal: 172.16.0.220,3260]
Nov 06 22:38:28 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f, portal: 172.16.0.220,3260] successful.
Nov 06 22:38:28 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee777b87-f357-4f11-b15f-22c63c2623d8]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[83491bb6-7958-4b1f-a3f2-efc48796c90d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:38:28 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:28 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96a8413-eccd-4b06-924a-f4e423df11e1]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] No VIF found with MAC fa:16:3e:45:38:7c, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:38:28 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.869s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f7038080-eec6-433f-b66f-c86bfdacd251 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 82.180s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.network.neutron [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:38:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.policy [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6b8ec49509748aab2ab06755faf2a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931a6fc1f8a405f83293c6685dc016e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:38:29 user nova-compute[75000]: INFO nova.virt.block_device [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Booting with volume e3b70ccb-55fe-46e6-8782-6913c98e0519 at /dev/vda
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.utils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6a7077-3f56-4a5a-a625-22bb57711a45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59844bb7-bb5d-4b26-aeef-00fb48773a2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80422ddf-40e1-4928-89e7-5b67da56071b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb0a825-6870-48b0-8f8b-e378d0bf7f17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:38:29 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:38:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f1d711-658b-4fad-80e5-62a35814846f]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.utils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating existing volume attachment record: 7e98800a-692d-4950-854f-d45fa9db8c86 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:38:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Instance destroyed successfully.
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyuWThg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] <== connect_volume: return (2554ms) {'type': 'block', 'scsi_wwn': '23365626163303736', 'path': '/dev/sdg'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365626163303736', 'path': '/dev/sdg'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71151378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71151378',id=28,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-36i77wnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:37:06Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=b06e5a39-e167-40c6-80a8-d70ca8e0ec7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:2f:f9,bridge_name='br-int',has_traffic_filtering=True,id=e93a0138-d9ce-4443-86c8-7325fd6fd86a,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93a0138-d9') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'pci_devices' on Instance uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:38:29 user nova-compute[75000]:   <uuid>b06e5a39-e167-40c6-80a8-d70ca8e0ec7f</uuid>
Nov 06 22:38:29 user nova-compute[75000]:   <name>instance-0000001c</name>
Nov 06 22:38:29 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:38:29 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:38:29 user nova-compute[75000]:   <metadata>
Nov 06 22:38:29 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:38:29 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:38:29 user nova-compute[75000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-71151378</nova:name>
Nov 06 22:38:29 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:38:27</nova:creationTime>
Nov 06 22:38:29 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:38:29 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:38:29 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:38:29 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:38:29 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:38:29 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:38:29 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:38:29 user nova-compute[75000]:       <nova:owner>
Nov 06 22:38:29 user nova-compute[75000]:         <nova:user uuid="ddbbf039233142eca9f4cdfe2396da7c">tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member</nova:user>
Nov 06 22:38:29 user nova-compute[75000]:         <nova:project uuid="3a7a8c838f784f309fb9f0066e3463ae">tempest-ServerBootFromVolumeStableRescueTest-294256413</nova:project>
Nov 06 22:38:29 user nova-compute[75000]:       </nova:owner>
Nov 06 22:38:29 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:38:29 user nova-compute[75000]:       <nova:ports>
Nov 06 22:38:29 user nova-compute[75000]:         <nova:port uuid="e93a0138-d9ce-4443-86c8-7325fd6fd86a">
Nov 06 22:38:29 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 22:38:29 user nova-compute[75000]:         </nova:port>
Nov 06 22:38:29 user nova-compute[75000]:       </nova:ports>
Nov 06 22:38:29 user nova-compute[75000]:     </nova:instance>
Nov 06 22:38:29 user nova-compute[75000]:   </metadata>
Nov 06 22:38:29 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:38:29 user nova-compute[75000]:     <system>
Nov 06 22:38:29 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:38:29 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:38:29 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:38:29 user nova-compute[75000]:       <entry name="serial">b06e5a39-e167-40c6-80a8-d70ca8e0ec7f</entry>
Nov 06 22:38:29 user nova-compute[75000]:       <entry name="uuid">b06e5a39-e167-40c6-80a8-d70ca8e0ec7f</entry>
Nov 06 22:38:29 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:38:29 user nova-compute[75000]:     </system>
Nov 06 22:38:29 user nova-compute[75000]:   </sysinfo>
Nov 06 22:38:29 user nova-compute[75000]:   <os>
Nov 06 22:38:29 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:38:29 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:38:29 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:38:29 user nova-compute[75000]:   </os>
Nov 06 22:38:29 user nova-compute[75000]:   <features>
Nov 06 22:38:29 user nova-compute[75000]:     <acpi/>
Nov 06 22:38:29 user nova-compute[75000]:     <apic/>
Nov 06 22:38:29 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:38:29 user nova-compute[75000]:   </features>
Nov 06 22:38:29 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:38:29 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:38:29 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:38:29 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:38:29 user nova-compute[75000]:   </clock>
Nov 06 22:38:29 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:38:29 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:38:29 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:38:29 user nova-compute[75000]:   </cpu>
Nov 06 22:38:29 user nova-compute[75000]:   <devices>
Nov 06 22:38:29 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:38:29 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:38:29 user nova-compute[75000]:       <source dev="/dev/sdg"/>
Nov 06 22:38:29 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:38:29 user nova-compute[75000]:       <serial>9a4f063c-96fc-4297-84ff-81acd181ad5f</serial>
Nov 06 22:38:29 user nova-compute[75000]:     </disk>
Nov 06 22:38:29 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:38:29 user nova-compute[75000]:       <mac address="fa:16:3e:53:2f:f9"/>
Nov 06 22:38:29 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:38:29 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:38:29 user nova-compute[75000]:       <target dev="tape93a0138-d9"/>
Nov 06 22:38:29 user nova-compute[75000]:     </interface>
Nov 06 22:38:29 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:38:29 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/console.log" append="off"/>
Nov 06 22:38:29 user nova-compute[75000]:     </serial>
Nov 06 22:38:29 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:38:29 user nova-compute[75000]:     <video>
Nov 06 22:38:29 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:38:29 user nova-compute[75000]:     </video>
Nov 06 22:38:29 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:38:29 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:38:29 user nova-compute[75000]:     </rng>
Nov 06 22:38:29 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:38:29 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:38:29 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:38:29 user nova-compute[75000]:     </memballoon>
Nov 06 22:38:29 user nova-compute[75000]:   </devices>
Nov 06 22:38:29 user nova-compute[75000]: </domain>
Nov 06 22:38:29 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71151378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71151378',id=28,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-36i77wnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:37:06Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=b06e5a39-e167-40c6-80a8-d70ca8e0ec7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:2f:f9,bridge_name='br-int',has_traffic_filtering=True,id=e93a0138-d9ce-4443-86c8-7325fd6fd86a,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93a0138-d9') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG os_vif [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:2f:f9,bridge_name='br-int',has_traffic_filtering=True,id=e93a0138-d9ce-4443-86c8-7325fd6fd86a,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93a0138-d9') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9df2487a-5e6b-5c31-8bca-1a90704ecb35', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape93a0138-d9, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape93a0138-d9, col_values=(('qos', UUID('c5178ac5-42f8-4fdb-a7b2-952914af1141')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape93a0138-d9, col_values=(('external_ids', {'iface-id': 'e93a0138-d9ce-4443-86c8-7325fd6fd86a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:2f:f9', 'vm-uuid': 'b06e5a39-e167-40c6-80a8-d70ca8e0ec7f'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:38:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:29 user nova-compute[75000]: INFO os_vif [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:2f:f9,bridge_name='br-int',has_traffic_filtering=True,id=e93a0138-d9ce-4443-86c8-7325fd6fd86a,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93a0138-d9')
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No VIF found with MAC fa:16:3e:53:2f:f9, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.network.neutron [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Successfully created port: 813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received event network-vif-plugged-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] Acquiring lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] No waiting events found dispatching network-vif-plugged-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:30 user nova-compute[75000]: WARNING nova.compute.manager [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received unexpected event network-vif-plugged-f83d494a-02a3-4d33-bd92-891fc7a84497 for instance with vm_state building and task_state spawning.
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-unplugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-unplugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:30 user nova-compute[75000]: WARNING nova.compute.manager [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-unplugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:30 user nova-compute[75000]: WARNING nova.compute.manager [req-10228b5b-e47d-4bf4-96bb-c868da1473ff req-283f1260-772e-4a58-a944-bc24a814cbe2 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:38:30 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Instance spawned successfully.
Nov 06 22:38:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:31 user nova-compute[75000]: INFO nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Took 6.61 seconds to spawn the instance on the hypervisor.
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:38:31 user nova-compute[75000]: INFO nova.compute.manager [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Took 7.80 seconds to build instance.
Nov 06 22:38:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1aa5d235-eb61-4d2f-aeec-26b220326fb7 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.121s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Successfully updated port: 813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquired lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:38:31 user nova-compute[75000]: DEBUG nova.network.neutron [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-41c54e55-e74a-43b0-9682-1907997196fe req-ad04f994-5016-4b48-bc4c-2929ad62cebf service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-changed-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-41c54e55-e74a-43b0-9682-1907997196fe req-ad04f994-5016-4b48-bc4c-2929ad62cebf service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Refreshing instance network info cache due to event network-changed-813e48da-0008-4864-9dbd-002434796b1a. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-41c54e55-e74a-43b0-9682-1907997196fe req-ad04f994-5016-4b48-bc4c-2929ad62cebf service nova] Acquiring lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG nova.network.neutron [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating instance_info_cache with network_info: [{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-13804015-1e30-4181-97c3-f4965b784f40 req-f40a0b4f-496a-4129-8904-00a413147ee0 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-13804015-1e30-4181-97c3-f4965b784f40 req-f40a0b4f-496a-4129-8904-00a413147ee0 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-13804015-1e30-4181-97c3-f4965b784f40 req-f40a0b4f-496a-4129-8904-00a413147ee0 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-13804015-1e30-4181-97c3-f4965b784f40 req-f40a0b4f-496a-4129-8904-00a413147ee0 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-13804015-1e30-4181-97c3-f4965b784f40 req-f40a0b4f-496a-4129-8904-00a413147ee0 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:32 user nova-compute[75000]: WARNING nova.compute.manager [req-13804015-1e30-4181-97c3-f4965b784f40 req-f40a0b4f-496a-4129-8904-00a413147ee0 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state building and task_state spawning.
Nov 06 22:38:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Releasing lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Instance network_info: |[{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-41c54e55-e74a-43b0-9682-1907997196fe req-ad04f994-5016-4b48-bc4c-2929ad62cebf service nova] Acquired lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG nova.network.neutron [req-41c54e55-e74a-43b0-9682-1907997196fe req-ad04f994-5016-4b48-bc4c-2929ad62cebf service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Refreshing network info cache for port 813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:38:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:33 user nova-compute[75000]: DEBUG nova.network.neutron [req-41c54e55-e74a-43b0-9682-1907997196fe req-ad04f994-5016-4b48-bc4c-2929ad62cebf service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updated VIF entry in instance network info cache for port 813e48da-0008-4864-9dbd-002434796b1a. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:38:33 user nova-compute[75000]: DEBUG nova.network.neutron [req-41c54e55-e74a-43b0-9682-1907997196fe req-ad04f994-5016-4b48-bc4c-2929ad62cebf service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating instance_info_cache with network_info: [{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:38:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-41c54e55-e74a-43b0-9682-1907997196fe req-ad04f994-5016-4b48-bc4c-2929ad62cebf service nova] Releasing lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lazy-loading 'flavor' on Instance uuid 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.114s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:34 user nova-compute[75000]: WARNING nova.compute.manager [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:34 user nova-compute[75000]: WARNING nova.compute.manager [req-d0c703b5-5a12-4fc2-a345-02855a76f686 req-2ba36030-06ab-4ed8-90a0-dd9b87043b28 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Updating instance_info_cache with network_info: [{"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-ae09cdd9-51dd-4a22-9380-62819470946b req-80343015-93a5-470c-9cc8-bdf611039ea6 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ae09cdd9-51dd-4a22-9380-62819470946b req-80343015-93a5-470c-9cc8-bdf611039ea6 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ae09cdd9-51dd-4a22-9380-62819470946b req-80343015-93a5-470c-9cc8-bdf611039ea6 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ae09cdd9-51dd-4a22-9380-62819470946b req-80343015-93a5-470c-9cc8-bdf611039ea6 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.compute.manager [req-ae09cdd9-51dd-4a22-9380-62819470946b req-80343015-93a5-470c-9cc8-bdf611039ea6 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:38:34 user nova-compute[75000]: WARNING nova.compute.manager [req-ae09cdd9-51dd-4a22-9380-62819470946b req-80343015-93a5-470c-9cc8-bdf611039ea6 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state building and task_state spawning.
Nov 06 22:38:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:34 user nova-compute[75000]: INFO nova.compute.manager [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Attaching volume 9323efd5-d502-4083-9a7d-00abbdde7bf7 to /dev/vdc
Nov 06 22:38:35 user nova-compute[75000]: DEBUG os_brick.utils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec06f0-3134-4084-b21f-282e2e636d3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c79c74-fa76-4ad4-9354-0e4b5498d1c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b8c30e-c262-4ef4-a489-d0e62290c89e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d00860-9544-4c8f-bb3b-e5a89817773d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:38:35 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa8b7c-826e-4681-90bb-804a718785d1]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG os_brick.utils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Updating existing volume attachment record: 036f767b-5ae5-4bcd-89c2-7e727bdbb7cc {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-efaa8b99-243e-46ff-a994-3ee6f81e3c95 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:38:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Instance spawned successfully.
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:38:35 user nova-compute[75000]: INFO nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Took 8.44 seconds to spawn the instance on the hypervisor.
Nov 06 22:38:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:38:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:35 user nova-compute[75000]: INFO nova.compute.manager [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Took 90.91 seconds to build instance.
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ee5c4ca-2cbb-4e92-a143-d4d5d9af680e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 91.287s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.352s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.287s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:38:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:38:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:38:43 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:43 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7268MB free_disk=24.99549102783203GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 3dfe6744-55ec-4294-8fda-5689879ed46b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0bd209e9-b6c8-4663-a443-77d251b3d802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c06fdcaf-015a-4f5e-9907-c95d1a775141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b06e5a39-e167-40c6-80a8-d70ca8e0ec7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 28438841-a940-4f76-ac21-2ec0a70bf6d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:38:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.780s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:38:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:38:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:38:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:38:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:38:44 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:38:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:38:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:38:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Creating image(s)
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Ensure instance console log exists: /opt/stack/data/nova/instances/2ea4dcf9-775b-4f7c-8cac-0a325a74dc65/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Start _get_guest_xml network_info=[{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peNCnhEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ea4dcf9-775b-4f7c-8cac-0a325a74dc65', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3b70ccb-55fe-46e6-8782-6913c98e0519', 'serial': 'e3b70ccb-55fe-46e6-8782-6913c98e0519'}, 'attachment_id': '7e98800a-692d-4950-854f-d45fa9db8c86', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:38:57 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:57 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peNCnhEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:38:57 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:38:57 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:38:57 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[18199d89-868d-4d12-b472-a421cdf51936]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:38:57 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5344cdd7-e6f6-41f3-a60d-16d7412f62fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519] added
Nov 06 22:38:57 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa498979-72d2-4104-81a6-7371d60c528b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c95c2dd-527a-4b5d-9088-b9e1a0703ad0]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peNCnhEY {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peNCnhEY" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f4016-d22d-440a-83d1-dee27c9a1ae9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'peNCnhEY'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[846c5793-3f26-4d7c-ae2b-2fbe6c407f5f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb3a755-cd2e-40a2-9630-950e7a9ce218]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85568e9-697e-4428-865c-2bd0bfe35088]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260]
Nov 06 22:38:57 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260] successful.
Nov 06 22:38:57 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3741242-4eb8-4edb-807d-ec848dfa9513]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d5eb8e-4476-4696-bcae-52c74198dd72]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:38:57 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] HCTL ('39', '-', '-', 0) found on session 29 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:38:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:38:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:38:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[468b0d70-bcec-435d-9d9f-ce14c28cb3c0]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:38:58 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching for a device in session 29 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:38:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peNCnhEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26562396364323933', 'path': '/dev/sdh'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562396364323933', 'path': '/dev/sdh'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1148922530',display_name='tempest-ServerActionsTestOtherA-server-1148922530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1148922530',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWWSt8DqD1UiX7y0P2zcc1XaSgfLqWPMHCsT4qhuCpJN/KYahOdMyvjBaIfA8wTAtF3OG7T0GjKSjZNjN+adINTC3kMpTN5nU53yfK9kl9yrZK3oIAKJYF1R8Z+Truelg==',key_name='tempest-keypair-832438895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-g4bey4gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=2ea4dcf9-775b-4f7c-8cac-0a325a74dc65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.objects.instance [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:38:59 user nova-compute[75000]:   <uuid>2ea4dcf9-775b-4f7c-8cac-0a325a74dc65</uuid>
Nov 06 22:38:59 user nova-compute[75000]:   <name>instance-00000020</name>
Nov 06 22:38:59 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:38:59 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:38:59 user nova-compute[75000]:   <metadata>
Nov 06 22:38:59 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:38:59 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:38:59 user nova-compute[75000]:       <nova:name>tempest-ServerActionsTestOtherA-server-1148922530</nova:name>
Nov 06 22:38:59 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:38:57</nova:creationTime>
Nov 06 22:38:59 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:38:59 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:38:59 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:38:59 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:38:59 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:38:59 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:38:59 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:38:59 user nova-compute[75000]:       <nova:owner>
Nov 06 22:38:59 user nova-compute[75000]:         <nova:user uuid="c6b8ec49509748aab2ab06755faf2a2d">tempest-ServerActionsTestOtherA-287714099-project-member</nova:user>
Nov 06 22:38:59 user nova-compute[75000]:         <nova:project uuid="c931a6fc1f8a405f83293c6685dc016e">tempest-ServerActionsTestOtherA-287714099</nova:project>
Nov 06 22:38:59 user nova-compute[75000]:       </nova:owner>
Nov 06 22:38:59 user nova-compute[75000]:       <nova:ports>
Nov 06 22:38:59 user nova-compute[75000]:         <nova:port uuid="813e48da-0008-4864-9dbd-002434796b1a">
Nov 06 22:38:59 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:38:59 user nova-compute[75000]:         </nova:port>
Nov 06 22:38:59 user nova-compute[75000]:       </nova:ports>
Nov 06 22:38:59 user nova-compute[75000]:     </nova:instance>
Nov 06 22:38:59 user nova-compute[75000]:   </metadata>
Nov 06 22:38:59 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:38:59 user nova-compute[75000]:     <system>
Nov 06 22:38:59 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:38:59 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:38:59 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:38:59 user nova-compute[75000]:       <entry name="serial">2ea4dcf9-775b-4f7c-8cac-0a325a74dc65</entry>
Nov 06 22:38:59 user nova-compute[75000]:       <entry name="uuid">2ea4dcf9-775b-4f7c-8cac-0a325a74dc65</entry>
Nov 06 22:38:59 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:38:59 user nova-compute[75000]:     </system>
Nov 06 22:38:59 user nova-compute[75000]:   </sysinfo>
Nov 06 22:38:59 user nova-compute[75000]:   <os>
Nov 06 22:38:59 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:38:59 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:38:59 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:38:59 user nova-compute[75000]:   </os>
Nov 06 22:38:59 user nova-compute[75000]:   <features>
Nov 06 22:38:59 user nova-compute[75000]:     <acpi/>
Nov 06 22:38:59 user nova-compute[75000]:     <apic/>
Nov 06 22:38:59 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:38:59 user nova-compute[75000]:   </features>
Nov 06 22:38:59 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:38:59 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:38:59 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:38:59 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:38:59 user nova-compute[75000]:   </clock>
Nov 06 22:38:59 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:38:59 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:38:59 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:38:59 user nova-compute[75000]:   </cpu>
Nov 06 22:38:59 user nova-compute[75000]:   <devices>
Nov 06 22:38:59 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:38:59 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:38:59 user nova-compute[75000]:       <source dev="/dev/sdh"/>
Nov 06 22:38:59 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:38:59 user nova-compute[75000]:       <serial>e3b70ccb-55fe-46e6-8782-6913c98e0519</serial>
Nov 06 22:38:59 user nova-compute[75000]:     </disk>
Nov 06 22:38:59 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:38:59 user nova-compute[75000]:       <mac address="fa:16:3e:61:00:b1"/>
Nov 06 22:38:59 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:38:59 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:38:59 user nova-compute[75000]:       <target dev="tap813e48da-00"/>
Nov 06 22:38:59 user nova-compute[75000]:     </interface>
Nov 06 22:38:59 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:38:59 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/2ea4dcf9-775b-4f7c-8cac-0a325a74dc65/console.log" append="off"/>
Nov 06 22:38:59 user nova-compute[75000]:     </serial>
Nov 06 22:38:59 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:38:59 user nova-compute[75000]:     <video>
Nov 06 22:38:59 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:38:59 user nova-compute[75000]:     </video>
Nov 06 22:38:59 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:38:59 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:38:59 user nova-compute[75000]:     </rng>
Nov 06 22:38:59 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:38:59 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:38:59 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:38:59 user nova-compute[75000]:     </memballoon>
Nov 06 22:38:59 user nova-compute[75000]:   </devices>
Nov 06 22:38:59 user nova-compute[75000]: </domain>
Nov 06 22:38:59 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1148922530',display_name='tempest-ServerActionsTestOtherA-server-1148922530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1148922530',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWWSt8DqD1UiX7y0P2zcc1XaSgfLqWPMHCsT4qhuCpJN/KYahOdMyvjBaIfA8wTAtF3OG7T0GjKSjZNjN+adINTC3kMpTN5nU53yfK9kl9yrZK3oIAKJYF1R8Z+Truelg==',key_name='tempest-keypair-832438895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-g4bey4gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=2ea4dcf9-775b-4f7c-8cac-0a325a74dc65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG os_vif [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aef1fde4-72b7-582d-ac20-19f4c7bd84e1', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap813e48da-00, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap813e48da-00, col_values=(('qos', UUID('cba024f3-4b49-4d2a-a733-e2deb1549b6f')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap813e48da-00, col_values=(('external_ids', {'iface-id': '813e48da-0008-4864-9dbd-002434796b1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:00:b1', 'vm-uuid': '2ea4dcf9-775b-4f7c-8cac-0a325a74dc65'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:38:59 user nova-compute[75000]: INFO os_vif [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00')
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:38:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No VIF found with MAC fa:16:3e:61:00:b1, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG nova.compute.manager [req-8dcce22d-d0fc-43af-bf56-225f481553f2 req-a781568f-4262-4a75-a438-73d02ec23b96 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8dcce22d-d0fc-43af-bf56-225f481553f2 req-a781568f-4262-4a75-a438-73d02ec23b96 service nova] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8dcce22d-d0fc-43af-bf56-225f481553f2 req-a781568f-4262-4a75-a438-73d02ec23b96 service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8dcce22d-d0fc-43af-bf56-225f481553f2 req-a781568f-4262-4a75-a438-73d02ec23b96 service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG nova.compute.manager [req-8dcce22d-d0fc-43af-bf56-225f481553f2 req-a781568f-4262-4a75-a438-73d02ec23b96 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] No waiting events found dispatching network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:00 user nova-compute[75000]: WARNING nova.compute.manager [req-8dcce22d-d0fc-43af-bf56-225f481553f2 req-a781568f-4262-4a75-a438-73d02ec23b96 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received unexpected event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a for instance with vm_state building and task_state spawning.
Nov 06 22:39:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-b67dfc9f-a565-4e13-ad46-c9400d781ed3 req-3f3f9573-8974-4e72-87cb-327d85c2f4dc service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dfc9f-a565-4e13-ad46-c9400d781ed3 req-3f3f9573-8974-4e72-87cb-327d85c2f4dc service nova] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dfc9f-a565-4e13-ad46-c9400d781ed3 req-3f3f9573-8974-4e72-87cb-327d85c2f4dc service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b67dfc9f-a565-4e13-ad46-c9400d781ed3 req-3f3f9573-8974-4e72-87cb-327d85c2f4dc service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-b67dfc9f-a565-4e13-ad46-c9400d781ed3 req-3f3f9573-8974-4e72-87cb-327d85c2f4dc service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] No waiting events found dispatching network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:02 user nova-compute[75000]: WARNING nova.compute.manager [req-b67dfc9f-a565-4e13-ad46-c9400d781ed3 req-3f3f9573-8974-4e72-87cb-327d85c2f4dc service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received unexpected event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a for instance with vm_state building and task_state spawning.
Nov 06 22:39:02 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Instance spawned successfully.
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:39:02 user nova-compute[75000]: INFO nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 06 22:39:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:39:02 user nova-compute[75000]: INFO nova.compute.manager [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Took 34.78 seconds to build instance.
Nov 06 22:39:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-17a1bec6-a51b-4a5e-a1be-4abd8df31a06 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.883s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaqVhQlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:39:03 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:39:03 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:39:03 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4a89d-e99a-4a65-9f41-c90aa7c9cc47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:39:03 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1580e3ea-07ee-46ce-9ad2-edc3bd488e19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7] added
Nov 06 22:39:03 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d43c6c-d143-42da-a807-065025082415]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae58031e-a5ff-4ead-9516-ff5587fc0546]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaqVhQlw {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaqVhQlw" returned: 0 in 0.040s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ed9fbd-20d9-4541-9941-08f847a5dc81]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xaqVhQlw'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.058s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cbf29c-47a9-4a47-bff9-9fb1ab6aad0a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[954c47c5-0e44-4209-ae57-2ae64f868dc9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac001c88-156d-4a7b-9dbe-a569d1f93131]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7, portal: 172.16.0.220,3260]
Nov 06 22:39:03 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7, portal: 172.16.0.220,3260] successful.
Nov 06 22:39:03 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb8cb93-7cd1-4544-9e47-5ceae842e915]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4d71a8-72ea-4ed8-8925-5f6a06f133dd]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:03 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] HCTL ('40', '-', '-', 0) found on session 30 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[030198cb-8165-4216-996d-a2ecf6a51fb0]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:03 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Searching for a device in session 30 and hctl ['40', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Searching for a device in session 30 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaqVhQlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '23162656161333262', 'path': '/dev/sdi'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162656161333262', 'path': '/dev/sdi'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lazy-loading 'flavor' on Instance uuid 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:39:04 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:39:04 user nova-compute[75000]:   <source dev="/dev/sdi"/>
Nov 06 22:39:04 user nova-compute[75000]:   <target dev="vdc" bus="virtio"/>
Nov 06 22:39:04 user nova-compute[75000]:   <serial>9323efd5-d502-4083-9a7d-00abbdde7bf7</serial>
Nov 06 22:39:04 user nova-compute[75000]: </disk>
Nov 06 22:39:04 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-fb828328-0d23-45df-a871-1596b19839d2 req-70623503-bd10-4045-b4cb-7f36fa92d185 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received event network-changed-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-fb828328-0d23-45df-a871-1596b19839d2 req-70623503-bd10-4045-b4cb-7f36fa92d185 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Refreshing instance network info cache due to event network-changed-8106fcc8-1c86-4441-8f27-462700afb2f2. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fb828328-0d23-45df-a871-1596b19839d2 req-70623503-bd10-4045-b4cb-7f36fa92d185 service nova] Acquiring lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fb828328-0d23-45df-a871-1596b19839d2 req-70623503-bd10-4045-b4cb-7f36fa92d185 service nova] Acquired lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:39:04 user nova-compute[75000]: DEBUG nova.network.neutron [req-fb828328-0d23-45df-a871-1596b19839d2 req-70623503-bd10-4045-b4cb-7f36fa92d185 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Refreshing network info cache for port 8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] No VIF found with MAC fa:16:3e:45:38:7c, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8f0f878-cc68-4aab-b62e-a5e5c12bf9b6 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.220s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-fb828328-0d23-45df-a871-1596b19839d2 req-70623503-bd10-4045-b4cb-7f36fa92d185 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updated VIF entry in instance network info cache for port 8106fcc8-1c86-4441-8f27-462700afb2f2. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-fb828328-0d23-45df-a871-1596b19839d2 req-70623503-bd10-4045-b4cb-7f36fa92d185 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating instance_info_cache with network_info: [{"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fb828328-0d23-45df-a871-1596b19839d2 req-70623503-bd10-4045-b4cb-7f36fa92d185 service nova] Releasing lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:05 user nova-compute[75000]: INFO nova.compute.manager [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Detaching volume 9323efd5-d502-4083-9a7d-00abbdde7bf7
Nov 06 22:39:05 user nova-compute[75000]: INFO nova.virt.block_device [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Attempting to driver detach volume 9323efd5-d502-4083-9a7d-00abbdde7bf7 from mountpoint /dev/vdc
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Attempting to detach device vdc from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:39:05 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:39:05 user nova-compute[75000]:   <source dev="/dev/sdi"/>
Nov 06 22:39:05 user nova-compute[75000]:   <target dev="vdc" bus="virtio"/>
Nov 06 22:39:05 user nova-compute[75000]:   <serial>9323efd5-d502-4083-9a7d-00abbdde7bf7</serial>
Nov 06 22:39:05 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 22:39:05 user nova-compute[75000]: </disk>
Nov 06 22:39:05 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:39:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Successfully detached device vdc from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 from the persistent domain config.
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:39:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:39:05 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:39:05 user nova-compute[75000]:   <source dev="/dev/sdi"/>
Nov 06 22:39:05 user nova-compute[75000]:   <target dev="vdc" bus="virtio"/>
Nov 06 22:39:05 user nova-compute[75000]:   <serial>9323efd5-d502-4083-9a7d-00abbdde7bf7</serial>
Nov 06 22:39:05 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 22:39:05 user nova-compute[75000]: </disk>
Nov 06 22:39:05 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:39:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:39:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG nova.objects.instance [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:11 user nova-compute[75000]: INFO nova.compute.manager [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attaching volume e79a48e3-b999-491c-a317-1f254a8348b8 to /dev/vdb
Nov 06 22:39:11 user nova-compute[75000]: DEBUG os_brick.utils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1f4a49-dd33-4113-a288-38c2bb954f9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f8ebec-80b3-4d68-afdd-f98f5ca07525]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8425708a-f30a-4d8e-b81d-6984e8791229]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d323aa08-edfe-48cb-8606-088e4c37e5fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:39:11 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d7d4c-f7df-40fa-b64c-6f088e847f25]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG os_brick.utils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating existing volume attachment record: ecaa7564-06fd-48e2-ab90-9ac65ca157db {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:11 user nova-compute[75000]: INFO nova.compute.manager [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Detaching volume e80316b8-80c9-4a48-824d-b1c11fa1e633
Nov 06 22:39:11 user nova-compute[75000]: INFO nova.virt.block_device [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Attempting to driver detach volume e80316b8-80c9-4a48-824d-b1c11fa1e633 from mountpoint /dev/vdb
Nov 06 22:39:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Attempting to detach device vdb from instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:39:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:39:12 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:39:12 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:39:12 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:39:12 user nova-compute[75000]:   <serial>e80316b8-80c9-4a48-824d-b1c11fa1e633</serial>
Nov 06 22:39:12 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 22:39:12 user nova-compute[75000]: </disk>
Nov 06 22:39:12 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:39:12 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully detached device vdb from instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 from the persistent domain config.
Nov 06 22:39:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:39:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:39:12 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:39:12 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:39:12 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:39:12 user nova-compute[75000]:   <serial>e80316b8-80c9-4a48-824d-b1c11fa1e633</serial>
Nov 06 22:39:12 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 22:39:12 user nova-compute[75000]: </disk>
Nov 06 22:39:12 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:39:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:39:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:26 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 is timed out.
Nov 06 22:39:26 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Successfully detached device vdc from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 from the live domain config.
Nov 06 22:39:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaqVhQlw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:39:26 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5e61e1-ef1b-4954-ac91-d56b04318170]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:39:26 user nova-compute[75000]: No targets found.
Nov 06 22:39:26 user nova-compute[75000]: iSNS:
Nov 06 22:39:26 user nova-compute[75000]: No targets found.
Nov 06 22:39:26 user nova-compute[75000]: STATIC:
Nov 06 22:39:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633
Nov 06 22:39:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7
Nov 06 22:39:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363
Nov 06 22:39:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:39:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:39:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075
Nov 06 22:39:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:39:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4
Nov 06 22:39:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:26 user nova-compute[75000]: FIRMWARE:
Nov 06 22:39:26 user nova-compute[75000]: No targets found.
Nov 06 22:39:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:39:26 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:39:26 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de862741-26bf-41f3-a919-5060071c9860]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc7cb3e-3f25-41e4-a344-61ae94b5df53]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79fc5e4a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7'): ({'sdi'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Removing single pathed devices sdi {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36daa5cb-04c7-4e16-a446-15c894b7c7f4]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec66229-1b80-424f-8c7c-4030ca5dcd94]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Flushing IO for device /dev/sdi {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[992dc82f-eece-4030-9b71-eb5d2cf4b69a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aee540-aa5b-42ec-907d-81305d6887db]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] SCSI volumes sdi have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[489df33a-9614-4a1d-ad20-242ae1f98663]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[301c2670-1bf1-4f6f-9632-500bca0560b7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7, portal: 172.16.0.220,3260]
Nov 06 22:39:26 user nova-compute[75000]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7, portal: 172.16.0.220,3260] successful.
Nov 06 22:39:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9323efd5-d502-4083-9a7d-00abbdde7bf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8efc11-3199-4cb4-ba01-3de11ed298e9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] <== disconnect_volume: return (340ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:39:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:39:27 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lazy-loading 'flavor' on Instance uuid 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8162c9ea-7bf4-4439-9a9c-8ba98376f67b tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.910s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:32 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 is timed out.
Nov 06 22:39:32 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully detached device vdb from instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 from the live domain config.
Nov 06 22:39:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLuoRdnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:39:32 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b77a04-5df4-458c-9354-9990209a6927]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:39:32 user nova-compute[75000]: No targets found.
Nov 06 22:39:32 user nova-compute[75000]: iSNS:
Nov 06 22:39:32 user nova-compute[75000]: No targets found.
Nov 06 22:39:32 user nova-compute[75000]: STATIC:
Nov 06 22:39:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633
Nov 06 22:39:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363
Nov 06 22:39:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:39:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:39:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075
Nov 06 22:39:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:39:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:32 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4
Nov 06 22:39:32 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:39:32 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:39:32 user nova-compute[75000]: FIRMWARE:
Nov 06 22:39:32 user nova-compute[75000]: No targets found.
Nov 06 22:39:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:39:32 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:39:32 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3185a813-09d6-4576-8883-08c02c70ccba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a248804-a233-408f-9fde-ca68820ab93d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79fc2fc0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c27db29-f5a5-42be-a4c0-742fad9fe672]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[32476949-dda1-4c04-a73c-bb7b4887ef11]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[352953f7-11ae-45b4-ae5a-b6dc5c555d28]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff7e1dd-41c4-4286-8db0-69ff7942ef0b]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.062s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fac3f46-3294-4cc4-829a-c02f08bd2d7e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af50f8f-ebd6-424f-b048-b01a23a0980f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260]
Nov 06 22:39:32 user nova-compute[75000]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633, portal: 172.16.0.220,3260] successful.
Nov 06 22:39:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80316b8-80c9-4a48-824d-b1c11fa1e633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1319bc-5b25-4441-98f8-1fe2a9b0d78a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== disconnect_volume: return (430ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:39:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:39:33 user nova-compute[75000]: DEBUG nova.objects.instance [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef349d9-ecf9-4352-b142-0e27f0f6650a tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.055s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1e985b70-8be5-4ee6-bf16-914457829c93 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1e985b70-8be5-4ee6-bf16-914457829c93 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1e985b70-8be5-4ee6-bf16-914457829c93 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1e985b70-8be5-4ee6-bf16-914457829c93 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75000) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG nova.objects.instance [None req-1e985b70-8be5-4ee6-bf16-914457829c93 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-7d2147b9-7bbd-4c4e-bbe4-ac018f35f276 req-4b3c3568-9a50-4757-8438-d207b1a95461 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7d2147b9-7bbd-4c4e-bbe4-ac018f35f276 req-4b3c3568-9a50-4757-8438-d207b1a95461 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7d2147b9-7bbd-4c4e-bbe4-ac018f35f276 req-4b3c3568-9a50-4757-8438-d207b1a95461 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7d2147b9-7bbd-4c4e-bbe4-ac018f35f276 req-4b3c3568-9a50-4757-8438-d207b1a95461 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-7d2147b9-7bbd-4c4e-bbe4-ac018f35f276 req-4b3c3568-9a50-4757-8438-d207b1a95461 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:35 user nova-compute[75000]: WARNING nova.compute.manager [req-7d2147b9-7bbd-4c4e-bbe4-ac018f35f276 req-4b3c3568-9a50-4757-8438-d207b1a95461 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state active and task_state powering-off.
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance destroyed successfully.
Nov 06 22:39:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1e985b70-8be5-4ee6-bf16-914457829c93 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1e985b70-8be5-4ee6-bf16-914457829c93 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.033s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-c1b83586-800f-4ed0-8772-a6a6395fe717 req-7925f886-ae17-41d8-8cfe-7a8c970708f3 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c1b83586-800f-4ed0-8772-a6a6395fe717 req-7925f886-ae17-41d8-8cfe-7a8c970708f3 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c1b83586-800f-4ed0-8772-a6a6395fe717 req-7925f886-ae17-41d8-8cfe-7a8c970708f3 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c1b83586-800f-4ed0-8772-a6a6395fe717 req-7925f886-ae17-41d8-8cfe-7a8c970708f3 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-c1b83586-800f-4ed0-8772-a6a6395fe717 req-7925f886-ae17-41d8-8cfe-7a8c970708f3 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:37 user nova-compute[75000]: WARNING nova.compute.manager [req-c1b83586-800f-4ed0-8772-a6a6395fe717 req-7925f886-ae17-41d8-8cfe-7a8c970708f3 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state stopped and task_state None.
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJfrhXlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:39:37 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:39:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:39:37 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:39:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:39:37 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b746b680-c95b-4d2a-9ac5-b5c7d0c33333]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:39:37 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e995e510-e4fd-4343-9e14-0692d8bc7ffb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8] added
Nov 06 22:39:37 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[01447952-8a31-415f-8822-ca1a8e107618]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[399b9106-5fe0-43fd-8b33-e6da0b5cb8c8]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJfrhXlM {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJfrhXlM" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc1a824-d606-4459-9de8-a8ba205cae53]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJfrhXlM'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[346402ae-fc8c-4bb2-aa58-219797e2f04c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b96472-5d3f-4320-bcb5-dacd1508c6c7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ecf4b2-3abe-4301-8169-8a3d11bc0c1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8, portal: 172.16.0.220,3260]
Nov 06 22:39:38 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8, portal: 172.16.0.220,3260] successful.
Nov 06 22:39:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5685de70-e54e-424d-9d7c-9de61d1c97b5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b176e98b-c977-4e97-b5dd-07a62b43810d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.477s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc4c766-39a8-47ba-9c25-4f595f9d2b0f]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJfrhXlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== connect_volume: return (1528ms) {'type': 'block', 'scsi_wwn': '23534383130616330', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534383130616330', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:39:39 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:39:39 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:39:39 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:39:39 user nova-compute[75000]:   <serial>e79a48e3-b999-491c-a317-1f254a8348b8</serial>
Nov 06 22:39:39 user nova-compute[75000]: </disk>
Nov 06 22:39:39 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:39:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No VIF found with MAC fa:16:3e:a2:a0:8b, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-38af35c1-a431-4d37-a1c4-dde721c4b845 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.837s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:39:40 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:39:40 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:39:40 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=6675MB free_disk=24.927696228027344GB free_vcpus=-4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 3dfe6744-55ec-4294-8fda-5689879ed46b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0bd209e9-b6c8-4663-a443-77d251b3d802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c06fdcaf-015a-4f5e-9907-c95d1a775141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b06e5a39-e167-40c6-80a8-d70ca8e0ec7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 28438841-a940-4f76-ac21-2ec0a70bf6d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:39:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:42 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:39:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:39:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:39:42 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:39:43 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updating instance_info_cache with network_info: [{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:39:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:39:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:39:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:39:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:39:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:39:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:46 user nova-compute[75000]: INFO nova.compute.manager [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Rescuing
Nov 06 22:39:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:39:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquired lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:39:46 user nova-compute[75000]: DEBUG nova.network.neutron [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Updating instance_info_cache with network_info: [{"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Releasing lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-e18d7df1-0828-406a-a65c-88f7eee06d04 req-545beb7a-a245-41fd-ae13-b187a524f64e service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-unplugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e18d7df1-0828-406a-a65c-88f7eee06d04 req-545beb7a-a245-41fd-ae13-b187a524f64e service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e18d7df1-0828-406a-a65c-88f7eee06d04 req-545beb7a-a245-41fd-ae13-b187a524f64e service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e18d7df1-0828-406a-a65c-88f7eee06d04 req-545beb7a-a245-41fd-ae13-b187a524f64e service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-e18d7df1-0828-406a-a65c-88f7eee06d04 req-545beb7a-a245-41fd-ae13-b187a524f64e service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-unplugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:47 user nova-compute[75000]: WARNING nova.compute.manager [req-e18d7df1-0828-406a-a65c-88f7eee06d04 req-545beb7a-a245-41fd-ae13-b187a524f64e service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-unplugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state active and task_state rescuing.
Nov 06 22:39:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:47 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Instance destroyed successfully.
Nov 06 22:39:47 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Attempting a stable device rescue
Nov 06 22:39:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 22:39:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Instance directory exists: not creating {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 22:39:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Creating image(s)
Nov 06 22:39:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "/opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "/opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "/opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:48 user nova-compute[75000]: DEBUG nova.objects.instance [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'trusted_certs' on Instance uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "c249d87195cf219abb2bc26e363d08497b5267f9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "c249d87195cf219abb2bc26e363d08497b5267f9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:49 user nova-compute[75000]: INFO nova.compute.manager [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Terminating instance
Nov 06 22:39:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG nova.virt.images [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] f0ea5930-b80d-49ff-8887-2e4f7ef0ea9f was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9.part /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:49 user nova-compute[75000]: WARNING nova.compute.manager [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state active and task_state rescuing.
Nov 06 22:39:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received event network-vif-unplugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] Acquiring lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] No waiting events found dispatching network-vif-unplugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4bf3897-8785-4961-88ff-c7711fff0b6c req-0329a4c2-eae8-4166-8168-eef3c694bdc1 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received event network-vif-unplugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9.part /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9.converted" returned: 0 in 0.408s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "c249d87195cf219abb2bc26e363d08497b5267f9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.934s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "c249d87195cf219abb2bc26e363d08497b5267f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "c249d87195cf219abb2bc26e363d08497b5267f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Instance destroyed successfully.
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.instance [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lazy-loading 'resources' on Instance uuid c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1393190100',display_name='tempest-ServersNegativeTestJSON-server-1393190100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1393190100',id=16,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:30:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='248d06b9dfbf4cd69d8d9630aea9ab36',ramdisk_id='',reservation_id='r-fsg1x1u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1355389518',owner_user_name='tempest-ServersNegativeTestJSON-1355389518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:30:23Z,user_data=None,user_id='20cf456ef1044f7387512475b494365e',uuid=c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converting VIF {"id": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "address": "fa:16:3e:e6:6d:c5", "network": {"id": "0133ec96-7b67-49b7-af2b-41e5051e3d69", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1945515409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "248d06b9dfbf4cd69d8d9630aea9ab36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc89934ba-f1", "ovs_interfaceid": "c89934ba-f1c6-4320-9ee9-dd60b163aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=c89934ba-f1c6-4320-9ee9-dd60b163aa1d,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc89934ba-f1') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_vif [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=c89934ba-f1c6-4320-9ee9-dd60b163aa1d,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc89934ba-f1') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc89934ba-f1, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a8534d3-bf9f-4d9b-bddd-f3341cea4fc8) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:50 user nova-compute[75000]: INFO os_vif [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=c89934ba-f1c6-4320-9ee9-dd60b163aa1d,network=Network(0133ec96-7b67-49b7-af2b-41e5051e3d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc89934ba-f1')
Nov 06 22:39:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Deleting instance files /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2_del
Nov 06 22:39:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Deletion of /opt/stack/data/nova/instances/c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2_del complete
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9 --force-share --output=json" returned: 0 in 0.237s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9,backing_fmt=raw /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9,backing_fmt=raw /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue" returned: 0 in 0.115s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "c249d87195cf219abb2bc26e363d08497b5267f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.instance [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'migration_context' on Instance uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<b06e5a39-e167-40c6-80a8-d70ca8e0ec7f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Start _get_guest_xml network_info=[{"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "vif_mac": "fa:16:3e:53:2f:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f0ea5930-b80d-49ff-8887-2e4f7ef0ea9f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyuWThg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'b06e5a39-e167-40c6-80a8-d70ca8e0ec7f', 'attached_at': '', 'detached_at': '', 'volume_id': '9a4f063c-96fc-4297-84ff-81acd181ad5f', 'serial': '9a4f063c-96fc-4297-84ff-81acd181ad5f'}, 'attachment_id': 'f4416f45-a9fa-4f9d-9950-04832aaa8d12', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.instance [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'resources' on Instance uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<b06e5a39-e167-40c6-80a8-d70ca8e0ec7f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.instance [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'numa_topology' on Instance uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<b06e5a39-e167-40c6-80a8-d70ca8e0ec7f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:39:50 user nova-compute[75000]: INFO nova.compute.manager [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:39:50 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:39:50 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.instance [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'vcpu_model' on Instance uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<b06e5a39-e167-40c6-80a8-d70ca8e0ec7f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyuWThg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:39:50 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:39:50 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:39:50 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[651c2541-0d78-4879-a01f-a6ed9fe1c21e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HGyuWThg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 22:39:50 user nova-compute[75000]: node.name = iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:39:50 user nova-compute[75000]: node.tpgt = -1
Nov 06 22:39:50 user nova-compute[75000]: node.startup = automatic
Nov 06 22:39:50 user nova-compute[75000]: node.leading_login = No
Nov 06 22:39:50 user nova-compute[75000]: iface.iscsi_ifacename = default
Nov 06 22:39:50 user nova-compute[75000]: iface.net_ifacename = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.ipaddress = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.prefix_len = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.hwaddress = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.transport_name = tcp
Nov 06 22:39:50 user nova-compute[75000]: iface.initiatorname = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.state = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.vlan_id = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.vlan_priority = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.vlan_state = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.iface_num = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.mtu = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.port = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.bootproto = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.subnet_mask = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.gateway = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.dhcp_alt_client_id = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.dhcp_dns = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.dhcp_learn_iqn = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.dhcp_vendor_id_state = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.dhcp_vendor_id = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.dhcp_slp_da = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.fragmentation = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.gratuitous_arp = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.incoming_forwarding = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.tos_state = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.tos = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.ttl = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.delayed_ack = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.tcp_nagle = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.tcp_wsf_state = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.tcp_wsf = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.tcp_timer_scale = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.tcp_timestamp = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.redirect = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.def_task_mgmt_timeout = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.header_digest = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.data_digest = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.immediate_data = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.initial_r2t = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.data_seq_inorder = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.data_pdu_inorder = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.erl = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.max_receive_data_len = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.first_burst_len = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.max_outstanding_r2t = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.max_burst_len = 0
Nov 06 22:39:50 user nova-compute[75000]: iface.chap_auth = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.bidi_chap = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.strict_login_compliance = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.discovery_auth = <empty>
Nov 06 22:39:50 user nova-compute[75000]: iface.discovery_logout = <empty>
Nov 06 22:39:50 user nova-compute[75000]: node.discovery_address = <empty>
Nov 06 22:39:50 user nova-compute[75000]: node.discovery_port = 0
Nov 06 22:39:50 user nova-compute[75000]: node.discovery_type = static
Nov 06 22:39:50 user nova-compute[75000]: node.session.initial_cmdsn = 0
Nov 06 22:39:50 user nova-compute[75000]: node.session.initial_login_retry_max = 8
Nov 06 22:39:50 user nova-compute[75000]: node.session.xmit_thread_priority = -20
Nov 06 22:39:50 user nova-compute[75000]: node.session.cmds_max = 128
Nov 06 22:39:50 user nova-compute[75000]: node.session.queue_depth = 32
Nov 06 22:39:50 user nova-compute[75000]: node.session.nr_sessions = 1
Nov 06 22:39:50 user nova-compute[75000]: node.session.auth.authmethod = CHAP
Nov 06 22:39:50 user nova-compute[75000]: node.session.auth.username = HGyuWThg
Nov 06 22:39:50 user nova-compute[75000]: node.session.auth.password = ***
Nov 06 22:39:50 user nova-compute[75000]: node.session.auth.username_in = <empty>
Nov 06 22:39:50 user nova-compute[75000]: node.session.auth.password_in = <empty>
Nov 06 22:39:50 user nova-compute[75000]: node.session.auth.chap_algs = MD5
Nov 06 22:39:50 user nova-compute[75000]: node.session.timeo.replacement_timeout = 120
Nov 06 22:39:50 user nova-compute[75000]: node.session.err_timeo.abort_timeout = 15
Nov 06 22:39:50 user nova-compute[75000]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 22:39:50 user nova-compute[75000]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 22:39:50 user nova-compute[75000]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.FastAbort = Yes
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.InitialR2T = No
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.ImmediateData = Yes
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.MaxConnections = 1
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 22:39:50 user nova-compute[75000]: node.session.iscsi.ERL = 0
Nov 06 22:39:50 user nova-compute[75000]: node.session.scan = manual
Nov 06 22:39:50 user nova-compute[75000]: node.session.reopen_max = 0
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].address = 172.16.0.220
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].port = 3260
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].startup = manual
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].tcp.window_size = 524288
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].tcp.type_of_service = 0
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].timeo.logout_timeout = 15
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].timeo.login_timeout = 15
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].timeo.auth_timeout = 45
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].iscsi.DataDigest = None
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].iscsi.IFMarker = No
Nov 06 22:39:50 user nova-compute[75000]: node.conn[0].iscsi.OFMarker = No
Nov 06 22:39:50 user nova-compute[75000]: # END RECORD
Nov 06 22:39:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[df488a85-6bc3-4f18-abe0-102ecfa7072e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a62235-4ab7-4289-a63b-ad9dc65c7591]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGyuWThg {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGyuWThg" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[08674710-50b2-4af5-8aad-633eb71c5b22]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HGyuWThg'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d33fbd0-44f1-417c-a077-5acb416540d5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7757b5dd-223b-4552-9b32-9b3c89c4660c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:39:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] HCTL ('38', '0', '0', 0) found on session 28 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9bb13b-334f-40c0-bd87-366b20cc87cd]: (4, ('0 0 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Searching for a device in session 28 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyuWThg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '23365626163303736', 'path': '/dev/sdg'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365626163303736', 'path': '/dev/sdg'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71151378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71151378',id=28,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:38:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-36i77wnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:38:36Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=b06e5a39-e167-40c6-80a8-d70ca8e0ec7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "vif_mac": "fa:16:3e:53:2f:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "vif_mac": "fa:16:3e:53:2f:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:2f:f9,bridge_name='br-int',has_traffic_filtering=True,id=e93a0138-d9ce-4443-86c8-7325fd6fd86a,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93a0138-d9') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.instance [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'pci_devices' on Instance uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.objects.base [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Object Instance<b06e5a39-e167-40c6-80a8-d70ca8e0ec7f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:39:50 user nova-compute[75000]:   <uuid>b06e5a39-e167-40c6-80a8-d70ca8e0ec7f</uuid>
Nov 06 22:39:50 user nova-compute[75000]:   <name>instance-0000001c</name>
Nov 06 22:39:50 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:39:50 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:39:50 user nova-compute[75000]:   <metadata>
Nov 06 22:39:50 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:39:50 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:39:50 user nova-compute[75000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-71151378</nova:name>
Nov 06 22:39:50 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:39:50</nova:creationTime>
Nov 06 22:39:50 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:39:50 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:39:50 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:39:50 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:39:50 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:39:50 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:39:50 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:39:50 user nova-compute[75000]:       <nova:owner>
Nov 06 22:39:50 user nova-compute[75000]:         <nova:user uuid="ddbbf039233142eca9f4cdfe2396da7c">tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member</nova:user>
Nov 06 22:39:50 user nova-compute[75000]:         <nova:project uuid="3a7a8c838f784f309fb9f0066e3463ae">tempest-ServerBootFromVolumeStableRescueTest-294256413</nova:project>
Nov 06 22:39:50 user nova-compute[75000]:       </nova:owner>
Nov 06 22:39:50 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:39:50 user nova-compute[75000]:       <nova:ports>
Nov 06 22:39:50 user nova-compute[75000]:         <nova:port uuid="e93a0138-d9ce-4443-86c8-7325fd6fd86a">
Nov 06 22:39:50 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 22:39:50 user nova-compute[75000]:         </nova:port>
Nov 06 22:39:50 user nova-compute[75000]:       </nova:ports>
Nov 06 22:39:50 user nova-compute[75000]:     </nova:instance>
Nov 06 22:39:50 user nova-compute[75000]:   </metadata>
Nov 06 22:39:50 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:39:50 user nova-compute[75000]:     <system>
Nov 06 22:39:50 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:39:50 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:39:50 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:39:50 user nova-compute[75000]:       <entry name="serial">b06e5a39-e167-40c6-80a8-d70ca8e0ec7f</entry>
Nov 06 22:39:50 user nova-compute[75000]:       <entry name="uuid">b06e5a39-e167-40c6-80a8-d70ca8e0ec7f</entry>
Nov 06 22:39:50 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:39:50 user nova-compute[75000]:     </system>
Nov 06 22:39:50 user nova-compute[75000]:   </sysinfo>
Nov 06 22:39:50 user nova-compute[75000]:   <os>
Nov 06 22:39:50 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:39:50 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:39:50 user nova-compute[75000]:   </os>
Nov 06 22:39:50 user nova-compute[75000]:   <features>
Nov 06 22:39:50 user nova-compute[75000]:     <acpi/>
Nov 06 22:39:50 user nova-compute[75000]:     <apic/>
Nov 06 22:39:50 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:39:50 user nova-compute[75000]:   </features>
Nov 06 22:39:50 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:39:50 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:39:50 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:39:50 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:39:50 user nova-compute[75000]:   </clock>
Nov 06 22:39:50 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:39:50 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:39:50 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:39:50 user nova-compute[75000]:   </cpu>
Nov 06 22:39:50 user nova-compute[75000]:   <devices>
Nov 06 22:39:50 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:39:50 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:39:50 user nova-compute[75000]:       <source dev="/dev/sdg"/>
Nov 06 22:39:50 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:39:50 user nova-compute[75000]:       <serial>9a4f063c-96fc-4297-84ff-81acd181ad5f</serial>
Nov 06 22:39:50 user nova-compute[75000]:     </disk>
Nov 06 22:39:50 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:39:50 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:39:50 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue"/>
Nov 06 22:39:50 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:39:50 user nova-compute[75000]:       <boot order="1"/>
Nov 06 22:39:50 user nova-compute[75000]:     </disk>
Nov 06 22:39:50 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:39:50 user nova-compute[75000]:       <mac address="fa:16:3e:53:2f:f9"/>
Nov 06 22:39:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:39:50 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:39:50 user nova-compute[75000]:       <target dev="tape93a0138-d9"/>
Nov 06 22:39:50 user nova-compute[75000]:     </interface>
Nov 06 22:39:50 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:39:50 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/console.log" append="off"/>
Nov 06 22:39:50 user nova-compute[75000]:     </serial>
Nov 06 22:39:50 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:39:50 user nova-compute[75000]:     <video>
Nov 06 22:39:50 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:39:50 user nova-compute[75000]:     </video>
Nov 06 22:39:50 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:39:50 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:39:50 user nova-compute[75000]:     </rng>
Nov 06 22:39:50 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:39:50 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:39:50 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:39:50 user nova-compute[75000]:     </memballoon>
Nov 06 22:39:50 user nova-compute[75000]:   </devices>
Nov 06 22:39:50 user nova-compute[75000]: </domain>
Nov 06 22:39:50 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:39:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Instance destroyed successfully.
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:39:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] No VIF found with MAC fa:16:3e:53:2f:f9, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:39:51 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Took 0.52 seconds to deallocate network for instance.
Nov 06 22:39:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-40662979-f96d-40ec-a9b0-250d16148964 req-536b94cb-d156-4e39-8ef7-d22407ba81bc service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received event network-vif-deleted-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:51 user nova-compute[75000]: INFO nova.compute.manager [req-40662979-f96d-40ec-a9b0-250d16148964 req-536b94cb-d156-4e39-8ef7-d22407ba81bc service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Neutron deleted interface c89934ba-f1c6-4320-9ee9-dd60b163aa1d; detaching it from the instance and deleting it from the info cache
Nov 06 22:39:51 user nova-compute[75000]: DEBUG nova.network.neutron [req-40662979-f96d-40ec-a9b0-250d16148964 req-536b94cb-d156-4e39-8ef7-d22407ba81bc service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-40662979-f96d-40ec-a9b0-250d16148964 req-536b94cb-d156-4e39-8ef7-d22407ba81bc service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Detach interface failed, port_id=c89934ba-f1c6-4320-9ee9-dd60b163aa1d, reason: Instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:51 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Deleted allocations for instance c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2
Nov 06 22:39:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-f849c5a1-7ab2-45d9-87a3-545d5a9756ea req-a4acb188-ed79-4325-b135-a830bb91e529 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received event network-vif-plugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f849c5a1-7ab2-45d9-87a3-545d5a9756ea req-a4acb188-ed79-4325-b135-a830bb91e529 service nova] Acquiring lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f849c5a1-7ab2-45d9-87a3-545d5a9756ea req-a4acb188-ed79-4325-b135-a830bb91e529 service nova] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f849c5a1-7ab2-45d9-87a3-545d5a9756ea req-a4acb188-ed79-4325-b135-a830bb91e529 service nova] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-f849c5a1-7ab2-45d9-87a3-545d5a9756ea req-a4acb188-ed79-4325-b135-a830bb91e529 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] No waiting events found dispatching network-vif-plugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:51 user nova-compute[75000]: WARNING nova.compute.manager [req-f849c5a1-7ab2-45d9-87a3-545d5a9756ea req-a4acb188-ed79-4325-b135-a830bb91e529 service nova] [instance: c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2] Received unexpected event network-vif-plugged-c89934ba-f1c6-4320-9ee9-dd60b163aa1d for instance with vm_state deleted and task_state None.
Nov 06 22:39:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7ff754f7-98b1-444e-a945-4c4557989562 tempest-ServersNegativeTestJSON-1355389518 tempest-ServersNegativeTestJSON-1355389518-project-member] Lock "c3ce05de-6c47-4ed8-bfc4-7f3cbd8a0da2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.504s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:53 user nova-compute[75000]: WARNING nova.compute.manager [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state active and task_state rescuing.
Nov 06 22:39:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:39:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:39:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:39:53 user nova-compute[75000]: WARNING nova.compute.manager [req-f78127ff-e22f-4c2c-ac9b-f47bd28c3a87 req-48d24d84-05a1-409e-8b71-3d80453db6d9 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state active and task_state rescuing.
Nov 06 22:39:54 user nova-compute[75000]: DEBUG nova.compute.manager [None req-07e6e8c8-a0e8-485b-ac04-6807546f6368 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:39:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:39:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:39:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:39:56 user nova-compute[75000]: INFO nova.compute.manager [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Detaching volume b71d212c-c8c9-49a4-9f55-9c38d90a45f4
Nov 06 22:39:56 user nova-compute[75000]: INFO nova.virt.block_device [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Attempting to driver detach volume b71d212c-c8c9-49a4-9f55-9c38d90a45f4 from mountpoint /dev/vdb
Nov 06 22:39:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Attempting to detach device vdb from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:39:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:39:56 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:39:56 user nova-compute[75000]:   <source dev="/dev/sdf"/>
Nov 06 22:39:56 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:39:56 user nova-compute[75000]:   <serial>b71d212c-c8c9-49a4-9f55-9c38d90a45f4</serial>
Nov 06 22:39:56 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:39:56 user nova-compute[75000]: </disk>
Nov 06 22:39:56 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:39:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Successfully detached device vdb from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 from the persistent domain config.
Nov 06 22:39:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:39:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:39:56 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:39:56 user nova-compute[75000]:   <source dev="/dev/sdf"/>
Nov 06 22:39:56 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:39:56 user nova-compute[75000]:   <serial>b71d212c-c8c9-49a4-9f55-9c38d90a45f4</serial>
Nov 06 22:39:56 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:39:56 user nova-compute[75000]: </disk>
Nov 06 22:39:56 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:39:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:40:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:40:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:40:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:40:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:40:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-861765b5-b5e1-493c-9225-5fb7bfb8f63e req-e8d2bc65-32c3-4649-a997-d28be51a8d48 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received event network-changed-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-861765b5-b5e1-493c-9225-5fb7bfb8f63e req-e8d2bc65-32c3-4649-a997-d28be51a8d48 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Refreshing instance network info cache due to event network-changed-65b301c5-8c5d-4f69-9664-ec9fa0df1f58. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-861765b5-b5e1-493c-9225-5fb7bfb8f63e req-e8d2bc65-32c3-4649-a997-d28be51a8d48 service nova] Acquiring lock "refresh_cache-fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-861765b5-b5e1-493c-9225-5fb7bfb8f63e req-e8d2bc65-32c3-4649-a997-d28be51a8d48 service nova] Acquired lock "refresh_cache-fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-861765b5-b5e1-493c-9225-5fb7bfb8f63e req-e8d2bc65-32c3-4649-a997-d28be51a8d48 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Refreshing network info cache for port 65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'flavor' on Instance uuid fd2235fd-3b64-4ff2-8350-aa3a9b092ecd {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:40:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Ignoring supplied device name: /dev/vdb
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:11 user nova-compute[75000]: INFO nova.compute.manager [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Attaching volume 908efb7e-e146-4c70-96fa-4816637579a2 to /dev/vdb
Nov 06 22:40:11 user nova-compute[75000]: DEBUG os_brick.utils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-861765b5-b5e1-493c-9225-5fb7bfb8f63e req-e8d2bc65-32c3-4649-a997-d28be51a8d48 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Updated VIF entry in instance network info cache for port 65b301c5-8c5d-4f69-9664-ec9fa0df1f58. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG nova.network.neutron [req-861765b5-b5e1-493c-9225-5fb7bfb8f63e req-e8d2bc65-32c3-4649-a997-d28be51a8d48 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Updating instance_info_cache with network_info: [{"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a6ad58-0a49-4915-a565-5d7ed780aed9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-861765b5-b5e1-493c-9225-5fb7bfb8f63e req-e8d2bc65-32c3-4649-a997-d28be51a8d48 service nova] Releasing lock "refresh_cache-fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae11953e-94cc-4a08-9a7b-baa937497589]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd56ef5a-15f9-49b9-adf6-1bb1cef673c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3f88ab-dd6f-4f40-b0ae-398ff6150270]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:40:11 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:40:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18d97b3-dd51-4158-a5a0-4c07ff9b40e6]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG os_brick.utils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:40:11 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Updating existing volume attachment record: 1bd75d8f-fc67-471e-80c1-ab6c2b6c2fab {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-ce65bf93-6257-4c9b-ba52-da796a40052d req-28b7a4a0-820f-4ccc-a589-1ff4a86a5a29 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received event network-changed-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-ce65bf93-6257-4c9b-ba52-da796a40052d req-28b7a4a0-820f-4ccc-a589-1ff4a86a5a29 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Refreshing instance network info cache due to event network-changed-f83d494a-02a3-4d33-bd92-891fc7a84497. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce65bf93-6257-4c9b-ba52-da796a40052d req-28b7a4a0-820f-4ccc-a589-1ff4a86a5a29 service nova] Acquiring lock "refresh_cache-28438841-a940-4f76-ac21-2ec0a70bf6d9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce65bf93-6257-4c9b-ba52-da796a40052d req-28b7a4a0-820f-4ccc-a589-1ff4a86a5a29 service nova] Acquired lock "refresh_cache-28438841-a940-4f76-ac21-2ec0a70bf6d9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-ce65bf93-6257-4c9b-ba52-da796a40052d req-28b7a4a0-820f-4ccc-a589-1ff4a86a5a29 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Refreshing network info cache for port f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "28438841-a940-4f76-ac21-2ec0a70bf6d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:14 user nova-compute[75000]: INFO nova.compute.manager [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Terminating instance
Nov 06 22:40:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-ce65bf93-6257-4c9b-ba52-da796a40052d req-28b7a4a0-820f-4ccc-a589-1ff4a86a5a29 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Updated VIF entry in instance network info cache for port f83d494a-02a3-4d33-bd92-891fc7a84497. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-ce65bf93-6257-4c9b-ba52-da796a40052d req-28b7a4a0-820f-4ccc-a589-1ff4a86a5a29 service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Updating instance_info_cache with network_info: [{"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce65bf93-6257-4c9b-ba52-da796a40052d req-28b7a4a0-820f-4ccc-a589-1ff4a86a5a29 service nova] Releasing lock "refresh_cache-28438841-a940-4f76-ac21-2ec0a70bf6d9" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-5c0f9611-fadf-4b34-9063-4ef977dcbef3 req-08a3c923-636f-4f95-81f9-65098964fd9e service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received event network-vif-unplugged-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5c0f9611-fadf-4b34-9063-4ef977dcbef3 req-08a3c923-636f-4f95-81f9-65098964fd9e service nova] Acquiring lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5c0f9611-fadf-4b34-9063-4ef977dcbef3 req-08a3c923-636f-4f95-81f9-65098964fd9e service nova] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5c0f9611-fadf-4b34-9063-4ef977dcbef3 req-08a3c923-636f-4f95-81f9-65098964fd9e service nova] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-5c0f9611-fadf-4b34-9063-4ef977dcbef3 req-08a3c923-636f-4f95-81f9-65098964fd9e service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] No waiting events found dispatching network-vif-unplugged-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-5c0f9611-fadf-4b34-9063-4ef977dcbef3 req-08a3c923-636f-4f95-81f9-65098964fd9e service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received event network-vif-unplugged-f83d494a-02a3-4d33-bd92-891fc7a84497 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:15 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Instance destroyed successfully.
Nov 06 22:40:15 user nova-compute[75000]: DEBUG nova.objects.instance [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'resources' on Instance uuid 28438841-a940-4f76-ac21-2ec0a70bf6d9 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2124686249',display_name='tempest-AttachVolumeNegativeTest-server-2124686249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2124686249',id=31,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOzU+TPLf7JQh+fj25jZUVGhCXW4qC1fLzWJjsr87Vk/06p7X0DFkWPceRuK2Vz/IzeIP3Qvw2p2xZW5VabJwJMQvltt0BxuKmxugXtKil9Dw8OrOljElDvxSS633g9tg==',key_name='tempest-keypair-477476533',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-308r72q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:38:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=28438841-a940-4f76-ac21-2ec0a70bf6d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "f83d494a-02a3-4d33-bd92-891fc7a84497", "address": "fa:16:3e:e7:d1:33", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83d494a-02", "ovs_interfaceid": "f83d494a-02a3-4d33-bd92-891fc7a84497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d1:33,bridge_name='br-int',has_traffic_filtering=True,id=f83d494a-02a3-4d33-bd92-891fc7a84497,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d494a-02') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG os_vif [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d1:33,bridge_name='br-int',has_traffic_filtering=True,id=f83d494a-02a3-4d33-bd92-891fc7a84497,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d494a-02') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf83d494a-02, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f296467-60e2-4038-bd14-8613673b9496) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:15 user nova-compute[75000]: INFO os_vif [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d1:33,bridge_name='br-int',has_traffic_filtering=True,id=f83d494a-02a3-4d33-bd92-891fc7a84497,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83d494a-02')
Nov 06 22:40:15 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Deleting instance files /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9_del
Nov 06 22:40:15 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Deletion of /opt/stack/data/nova/instances/28438841-a940-4f76-ac21-2ec0a70bf6d9_del complete
Nov 06 22:40:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:15 user nova-compute[75000]: INFO nova.compute.manager [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 06 22:40:15 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:40:15 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:16 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Took 0.85 seconds to deallocate network for instance.
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:16 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Deleted allocations for instance 28438841-a940-4f76-ac21-2ec0a70bf6d9
Nov 06 22:40:16 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 is timed out.
Nov 06 22:40:16 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Successfully detached device vdb from instance 0bd209e9-b6c8-4663-a443-77d251b3d802 from the live domain config.
Nov 06 22:40:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXZLsncI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:40:16 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b013a3-711c-48d7-9964-a4853348cabb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:40:16 user nova-compute[75000]: No targets found.
Nov 06 22:40:16 user nova-compute[75000]: iSNS:
Nov 06 22:40:16 user nova-compute[75000]: No targets found.
Nov 06 22:40:16 user nova-compute[75000]: STATIC:
Nov 06 22:40:16 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363
Nov 06 22:40:16 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:16 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:16 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:40:16 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:16 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:16 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:40:16 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:16 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:16 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075
Nov 06 22:40:16 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:16 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:16 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:40:16 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:16 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:16 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4
Nov 06 22:40:16 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:16 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:16 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8
Nov 06 22:40:16 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:16 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:16 user nova-compute[75000]: FIRMWARE:
Nov 06 22:40:16 user nova-compute[75000]: No targets found.
Nov 06 22:40:16 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:40:16 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:40:16 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26d62c2-513d-46ed-82e5-5f089996dc2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dff71d24-0fde-447f-88e9-ce8a5f73790d tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.313s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b27b99-8e94-4ad5-b51d-4485c65f23fa]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:16 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc149750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4'): ({'sdf'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Removing single pathed devices sdf {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-14e0d3f0-95c6-4529-8b0c-53a7d4032508 req-97947aa8-f119-4955-8e07-fe328ad9574f service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received event network-vif-plugged-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-14e0d3f0-95c6-4529-8b0c-53a7d4032508 req-97947aa8-f119-4955-8e07-fe328ad9574f service nova] Acquiring lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-14e0d3f0-95c6-4529-8b0c-53a7d4032508 req-97947aa8-f119-4955-8e07-fe328ad9574f service nova] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-14e0d3f0-95c6-4529-8b0c-53a7d4032508 req-97947aa8-f119-4955-8e07-fe328ad9574f service nova] Lock "28438841-a940-4f76-ac21-2ec0a70bf6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-14e0d3f0-95c6-4529-8b0c-53a7d4032508 req-97947aa8-f119-4955-8e07-fe328ad9574f service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] No waiting events found dispatching network-vif-plugged-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:40:16 user nova-compute[75000]: WARNING nova.compute.manager [req-14e0d3f0-95c6-4529-8b0c-53a7d4032508 req-97947aa8-f119-4955-8e07-fe328ad9574f service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received unexpected event network-vif-plugged-f83d494a-02a3-4d33-bd92-891fc7a84497 for instance with vm_state deleted and task_state None.
Nov 06 22:40:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-14e0d3f0-95c6-4529-8b0c-53a7d4032508 req-97947aa8-f119-4955-8e07-fe328ad9574f service nova] [instance: 28438841-a940-4f76-ac21-2ec0a70bf6d9] Received event network-vif-deleted-f83d494a-02a3-4d33-bd92-891fc7a84497 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[852b5391-cd2c-4bc9-aabd-7cdae2424dd1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db85c96-3f60-45d3-9a6e-5d79b2734a65]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Flushing IO for device /dev/sdf {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65a995d-888d-4fc7-b851-108503382589]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f85d6e5-3550-4424-97c5-472a16654c48]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:16 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] SCSI volumes sdf have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21b49ea-a0fe-40cf-bddd-9ed15aba104f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47284c5-e49f-400c-86c6-4a3ddde0d69d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4, portal: 172.16.0.220,3260]
Nov 06 22:40:17 user nova-compute[75000]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4, portal: 172.16.0.220,3260] successful.
Nov 06 22:40:17 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b71d212c-c8c9-49a4-9f55-9c38d90a45f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c9102-3370-490f-9e9d-5566724553df]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] <== disconnect_volume: return (380ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:40:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:40:18 user nova-compute[75000]: DEBUG nova.objects.instance [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lazy-loading 'flavor' on Instance uuid 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:40:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-eada34f0-4127-4789-839f-4d2b1db511fa tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.064s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-c5b2359c-22c8-4dd2-b033-43e77cf39764 req-fa6e3e5d-9688-4527-b1e6-b2df8f3676ea service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received event network-changed-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-c5b2359c-22c8-4dd2-b033-43e77cf39764 req-fa6e3e5d-9688-4527-b1e6-b2df8f3676ea service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Refreshing instance network info cache due to event network-changed-7a108ec5-3780-43e6-a8da-e1a44ecffd8e. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:40:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c5b2359c-22c8-4dd2-b033-43e77cf39764 req-fa6e3e5d-9688-4527-b1e6-b2df8f3676ea service nova] Acquiring lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c5b2359c-22c8-4dd2-b033-43e77cf39764 req-fa6e3e5d-9688-4527-b1e6-b2df8f3676ea service nova] Acquired lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:19 user nova-compute[75000]: DEBUG nova.network.neutron [req-c5b2359c-22c8-4dd2-b033-43e77cf39764 req-fa6e3e5d-9688-4527-b1e6-b2df8f3676ea service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Refreshing network info cache for port 7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:40:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:20 user nova-compute[75000]: DEBUG nova.network.neutron [req-c5b2359c-22c8-4dd2-b033-43e77cf39764 req-fa6e3e5d-9688-4527-b1e6-b2df8f3676ea service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updated VIF entry in instance network info cache for port 7a108ec5-3780-43e6-a8da-e1a44ecffd8e. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:40:20 user nova-compute[75000]: DEBUG nova.network.neutron [req-c5b2359c-22c8-4dd2-b033-43e77cf39764 req-fa6e3e5d-9688-4527-b1e6-b2df8f3676ea service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updating instance_info_cache with network_info: [{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c5b2359c-22c8-4dd2-b033-43e77cf39764 req-fa6e3e5d-9688-4527-b1e6-b2df8f3676ea service nova] Releasing lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:20 user nova-compute[75000]: INFO nova.compute.manager [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Detaching volume d2c4eb58-53b5-401f-b93d-85ab09be2363
Nov 06 22:40:20 user nova-compute[75000]: INFO nova.virt.block_device [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Attempting to driver detach volume d2c4eb58-53b5-401f-b93d-85ab09be2363 from mountpoint /dev/vdb
Nov 06 22:40:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Attempting to detach device vdb from instance 3dfe6744-55ec-4294-8fda-5689879ed46b from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:40:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:40:20 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:40:20 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 22:40:20 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:40:20 user nova-compute[75000]:   <serial>d2c4eb58-53b5-401f-b93d-85ab09be2363</serial>
Nov 06 22:40:20 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:40:20 user nova-compute[75000]: </disk>
Nov 06 22:40:20 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:40:20 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Successfully detached device vdb from instance 3dfe6744-55ec-4294-8fda-5689879ed46b from the persistent domain config.
Nov 06 22:40:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3dfe6744-55ec-4294-8fda-5689879ed46b from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:40:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:40:20 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:40:20 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 22:40:20 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:40:20 user nova-compute[75000]:   <serial>d2c4eb58-53b5-401f-b93d-85ab09be2363</serial>
Nov 06 22:40:20 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:40:20 user nova-compute[75000]: </disk>
Nov 06 22:40:20 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:40:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:40:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-changed-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Refreshing instance network info cache due to event network-changed-813e48da-0008-4864-9dbd-002434796b1a. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:40:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] Acquiring lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] Acquired lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:21 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Refreshing network info cache for port 813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Stashing vm_state: active {{(pid=75000) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:40:22 user nova-compute[75000]: INFO nova.compute.claims [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Claim successful on node user
Nov 06 22:40:22 user nova-compute[75000]: INFO nova.compute.resource_tracker [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating resource usage from migration c9f4aeed-1861-426f-95b6-bf092c779e85
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updated VIF entry in instance network info cache for port 813e48da-0008-4864-9dbd-002434796b1a. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating instance_info_cache with network_info: [{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] Releasing lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-changed-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Refreshing instance network info cache due to event network-changed-7d134985-3e0b-4352-a829-46cc9efcaaa3. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] Acquiring lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] Acquired lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Refreshing network info cache for port 7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.615s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:22 user nova-compute[75000]: INFO nova.compute.manager [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Migrating
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquired lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updated VIF entry in instance network info cache for port 7d134985-3e0b-4352-a829-46cc9efcaaa3. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updating instance_info_cache with network_info: [{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] Releasing lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-changed-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Refreshing instance network info cache due to event network-changed-7d134985-3e0b-4352-a829-46cc9efcaaa3. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] Acquiring lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] Acquired lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:22 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Refreshing network info cache for port 7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating instance_info_cache with network_info: [{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Releasing lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:23 user nova-compute[75000]: INFO nova.compute.manager [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Detaching volume e79a48e3-b999-491c-a317-1f254a8348b8
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Starting migrate_disk_and_power_off {{(pid=75000) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 06 22:40:23 user nova-compute[75000]: INFO nova.virt.block_device [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attempting to driver detach volume e79a48e3-b999-491c-a317-1f254a8348b8 from mountpoint /dev/vdb
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Attempting to detach device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:40:23 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:40:23 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:40:23 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:40:23 user nova-compute[75000]:   <serial>e79a48e3-b999-491c-a317-1f254a8348b8</serial>
Nov 06 22:40:23 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:40:23 user nova-compute[75000]: </disk>
Nov 06 22:40:23 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:40:23 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully detached device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the persistent domain config.
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:40:23 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:40:23 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:40:23 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:40:23 user nova-compute[75000]:   <serial>e79a48e3-b999-491c-a317-1f254a8348b8</serial>
Nov 06 22:40:23 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:40:23 user nova-compute[75000]: </disk>
Nov 06 22:40:23 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updated VIF entry in instance network info cache for port 7d134985-3e0b-4352-a829-46cc9efcaaa3. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updating instance_info_cache with network_info: [{"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7e00a982-e362-4645-b4c7-aa92ee7ef5e7 req-30c81363-a7b5-4b8d-81c7-f45140af8fc7 service nova] Releasing lock "refresh_cache-3dfe6744-55ec-4294-8fda-5689879ed46b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-1ba068ad-fba9-43a1-b2d9-0c06f4d6e20b req-4bff785f-2473-4b7c-9cac-9c9e40342059 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-unplugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1ba068ad-fba9-43a1-b2d9-0c06f4d6e20b req-4bff785f-2473-4b7c-9cac-9c9e40342059 service nova] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1ba068ad-fba9-43a1-b2d9-0c06f4d6e20b req-4bff785f-2473-4b7c-9cac-9c9e40342059 service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1ba068ad-fba9-43a1-b2d9-0c06f4d6e20b req-4bff785f-2473-4b7c-9cac-9c9e40342059 service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-1ba068ad-fba9-43a1-b2d9-0c06f4d6e20b req-4bff785f-2473-4b7c-9cac-9c9e40342059 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] No waiting events found dispatching network-vif-unplugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:40:23 user nova-compute[75000]: WARNING nova.compute.manager [req-1ba068ad-fba9-43a1-b2d9-0c06f4d6e20b req-4bff785f-2473-4b7c-9cac-9c9e40342059 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received unexpected event network-vif-unplugged-813e48da-0008-4864-9dbd-002434796b1a for instance with vm_state active and task_state resize_migrating.
Nov 06 22:40:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:40:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Instance destroyed successfully.
Nov 06 22:40:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1148922530',display_name='tempest-ServerActionsTestOtherA-server-1148922530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1148922530',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWWSt8DqD1UiX7y0P2zcc1XaSgfLqWPMHCsT4qhuCpJN/KYahOdMyvjBaIfA8wTAtF3OG7T0GjKSjZNjN+adINTC3kMpTN5nU53yfK9kl9yrZK3oIAKJYF1R8Z+Truelg==',key_name='tempest-keypair-832438895',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-g4bey4gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:40:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=2ea4dcf9-775b-4f7c-8cac-0a325a74dc65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1437787295-network", "vif_mac": "fa:16:3e:61:00:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1437787295-network", "vif_mac": "fa:16:3e:61:00:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_vif [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap813e48da-00, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cba024f3-4b49-4d2a-a733-e2deb1549b6f) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:24 user nova-compute[75000]: INFO os_vif [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00')
Nov 06 22:40:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peNCnhEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:40:24 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed2797c-b888-4d59-9314-8924bf3b83d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:40:24 user nova-compute[75000]: No targets found.
Nov 06 22:40:24 user nova-compute[75000]: iSNS:
Nov 06 22:40:24 user nova-compute[75000]: No targets found.
Nov 06 22:40:24 user nova-compute[75000]: STATIC:
Nov 06 22:40:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363
Nov 06 22:40:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:40:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:40:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075
Nov 06 22:40:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:40:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8
Nov 06 22:40:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:24 user nova-compute[75000]: FIRMWARE:
Nov 06 22:40:24 user nova-compute[75000]: No targets found.
Nov 06 22:40:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:40:24 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:40:24 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82b3ede-7365-4bb9-9afe-bdfc6dc7383d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdc44dc-b73b-4c94-a05f-17db0ca55a1a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc1127a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519'): ({'sdh'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Removing single pathed devices sdh {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ed245a-8e01-4922-9e06-d7404ff0f55d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3593bb67-78a8-4d55-8175-fa751809a382]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flushing IO for device /dev/sdh {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e114b6-f6b4-44b3-8f5a-401623c2e70f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcfbb0a-9c8d-4e1b-906f-864d876b9e5f]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] SCSI volumes sdh have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[faca3287-cf2c-4273-9729-27858c08765f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d83693-bea6-40f5-838b-9c68f626b9cd]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260]
Nov 06 22:40:24 user nova-compute[75000]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260] successful.
Nov 06 22:40:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f405c1b6-7b29-4804-a1d4-93dd3e07e528]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== disconnect_volume: return (361ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:40:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:40:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-3cbe9366-b189-41b1-abf9-ef3f82a7e679 req-6cf846bb-6220-4030-b01e-dd30a4a5be3b service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3cbe9366-b189-41b1-abf9-ef3f82a7e679 req-6cf846bb-6220-4030-b01e-dd30a4a5be3b service nova] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3cbe9366-b189-41b1-abf9-ef3f82a7e679 req-6cf846bb-6220-4030-b01e-dd30a4a5be3b service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3cbe9366-b189-41b1-abf9-ef3f82a7e679 req-6cf846bb-6220-4030-b01e-dd30a4a5be3b service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-3cbe9366-b189-41b1-abf9-ef3f82a7e679 req-6cf846bb-6220-4030-b01e-dd30a4a5be3b service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] No waiting events found dispatching network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:40:25 user nova-compute[75000]: WARNING nova.compute.manager [req-3cbe9366-b189-41b1-abf9-ef3f82a7e679 req-6cf846bb-6220-4030-b01e-dd30a4a5be3b service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received unexpected event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a for instance with vm_state active and task_state resize_migrating.
Nov 06 22:40:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:34 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:40:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:40:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7499MB free_disk=24.883533477783203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Applying migration context for instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 as it has an incoming, in-progress migration c9f4aeed-1861-426f-95b6-bf092c779e85. Migration status is migrating {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 22:40:39 user nova-compute[75000]: INFO nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating resource usage from migration c9f4aeed-1861-426f-95b6-bf092c779e85
Nov 06 22:40:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 3dfe6744-55ec-4294-8fda-5689879ed46b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0bd209e9-b6c8-4663-a443-77d251b3d802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c06fdcaf-015a-4f5e-9907-c95d1a775141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b06e5a39-e167-40c6-80a8-d70ca8e0ec7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Migration c9f4aeed-1861-426f-95b6-bf092c779e85 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:40:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:40:40 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:40:40 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:40:40 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:40:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:41 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3dfe6744-55ec-4294-8fda-5689879ed46b is timed out.
Nov 06 22:40:41 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Successfully detached device vdb from instance 3dfe6744-55ec-4294-8fda-5689879ed46b from the live domain config.
Nov 06 22:40:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsKmtBrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:40:41 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade7a82-fbff-4599-8ce1-a72b85c7334b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:40:41 user nova-compute[75000]: No targets found.
Nov 06 22:40:41 user nova-compute[75000]: iSNS:
Nov 06 22:40:41 user nova-compute[75000]: No targets found.
Nov 06 22:40:41 user nova-compute[75000]: STATIC:
Nov 06 22:40:41 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363
Nov 06 22:40:41 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:41 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:41 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:40:41 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:41 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:41 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:40:41 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:41 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:41 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075
Nov 06 22:40:41 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:41 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:41 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8
Nov 06 22:40:41 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:41 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:41 user nova-compute[75000]: FIRMWARE:
Nov 06 22:40:41 user nova-compute[75000]: No targets found.
Nov 06 22:40:41 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:40:41 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:40:41 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d194962-acfb-4fa7-b46f-ab70e81b89c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb10bccc-798d-4905-a9b4-a2ed7aa50f4d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:40:41 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:41 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:41 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:40:41 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:41 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 (non-flash)
Nov 06 22:40:41 user nova-compute[75000]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:41 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:41 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:40:41 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:41 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc295f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363'): ({'sdd'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Removing single pathed devices sdd {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6933cc6a-101e-4dad-a318-883535443844]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab54dcb-2577-4166-a06d-99965e382e4c]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Flushing IO for device /dev/sdd {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[906b87d7-2a66-4716-b9f3-3d7c896fa05c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeb4883-5c11-45a1-ad8f-2de9a0173fff]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[107f757b-5ab9-498e-8143-a8fb42ff1012]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37b054e-5bd5-4582-b5e6-d8f3fd76d842]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363, portal: 172.16.0.220,3260]
Nov 06 22:40:41 user nova-compute[75000]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363, portal: 172.16.0.220,3260] successful.
Nov 06 22:40:41 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid bf3bafdf-dba5-4961-a891-98f522b27f53 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2c4eb58-53b5-401f-b93d-85ab09be2363 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae95ac9-92e5-4c72-a4b2-77702cacd06a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] <== disconnect_volume: return (391ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:40:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updating instance_info_cache with network_info: [{"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-bf3bafdf-dba5-4961-a891-98f522b27f53" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:40:42 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:40:44 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb is timed out.
Nov 06 22:40:44 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully detached device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the live domain config.
Nov 06 22:40:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJfrhXlM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:40:44 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb0dd0-86a5-4699-9b3d-28fc6f57e700]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:40:44 user nova-compute[75000]: No targets found.
Nov 06 22:40:44 user nova-compute[75000]: iSNS:
Nov 06 22:40:44 user nova-compute[75000]: No targets found.
Nov 06 22:40:44 user nova-compute[75000]: STATIC:
Nov 06 22:40:44 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:40:44 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:44 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:44 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:40:44 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:44 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:44 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075
Nov 06 22:40:44 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:44 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:44 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8
Nov 06 22:40:44 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:40:44 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:40:44 user nova-compute[75000]: FIRMWARE:
Nov 06 22:40:44 user nova-compute[75000]: No targets found.
Nov 06 22:40:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:40:44 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:40:44 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d63191f-afb6-40f7-b384-b423efb2062f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e37654-42a0-4e90-a80a-1c9075bd5b7f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:44 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:44 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:40:44 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:44 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:44 user nova-compute[75000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 (non-flash)
Nov 06 22:40:44 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7a093d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[17912c67-94f7-4a48-9be1-6da0fecdbdff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4479ef-f964-46fa-988c-faf3a4646d33]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c30281-5622-4f26-a153-4ded2c9e36f4]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51b54a-cfd0-4b55-9b2c-e4363e9b3e8a]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd75792b-2349-4d70-8394-7bda34e6dad5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f0b735-a755-48b1-9bf9-8d708644b39b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8, portal: 172.16.0.220,3260]
Nov 06 22:40:44 user nova-compute[75000]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8, portal: 172.16.0.220,3260] successful.
Nov 06 22:40:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e79a48e3-b999-491c-a317-1f254a8348b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a204c79-9d12-4232-b92d-5cdef4c5ca3d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== disconnect_volume: return (364ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:40:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:46 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Port 813e48da-0008-4864-9dbd-002434796b1a binding to destination host user is already ACTIVE {{(pid=75000) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 22:40:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquired lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:40:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating instance_info_cache with network_info: [{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Releasing lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG os_brick.utils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b265a2-153e-4540-8716-309ef4cbfa62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9b09c4-4ba0-4dfe-ae31-bcf308b4a309]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac4a305-1738-4d4e-878f-89c95868168f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[167ff6f3-5d70-42c3-878f-d1d2584e0f8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:40:48 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd99cfc-8e98-48bd-952a-322e0b758383]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG os_brick.utils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG nova.objects.instance [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-835486b7-5bd4-4c2d-8411-ec7d6f8bc880 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.252s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:48 user nova-compute[75000]: INFO nova.compute.manager [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Terminating instance
Nov 06 22:40:48 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'flavor' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c0efe11c-efab-4b5f-b0e8-d2cdf4cc662a tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.602s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-c7e6fc1d-c797-4e92-97b8-6d8aae36b113 req-dfc3975c-4cb4-40cd-962a-8e354eae0845 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received event network-vif-unplugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c7e6fc1d-c797-4e92-97b8-6d8aae36b113 req-dfc3975c-4cb4-40cd-962a-8e354eae0845 service nova] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c7e6fc1d-c797-4e92-97b8-6d8aae36b113 req-dfc3975c-4cb4-40cd-962a-8e354eae0845 service nova] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c7e6fc1d-c797-4e92-97b8-6d8aae36b113 req-dfc3975c-4cb4-40cd-962a-8e354eae0845 service nova] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-c7e6fc1d-c797-4e92-97b8-6d8aae36b113 req-dfc3975c-4cb4-40cd-962a-8e354eae0845 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] No waiting events found dispatching network-vif-unplugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-c7e6fc1d-c797-4e92-97b8-6d8aae36b113 req-dfc3975c-4cb4-40cd-962a-8e354eae0845 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received event network-vif-unplugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:40:49 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Instance destroyed successfully.
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lazy-loading 'resources' on Instance uuid 0bd209e9-b6c8-4663-a443-77d251b3d802 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:35:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-682901431',display_name='tempest-TestServerVolumeAttachmentScenario-server-682901431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-682901431',id=26,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1h8ZSOrkcpBbuUxvaOxk+QpM2E73Xu2yUhvNuMGZIElUDiZElxguXwDPpUgr3s9LwFAPWR09OnR8euephu9CUVoM/PS01/ess/ATXt0wK1co8MB/cF3aL15oarev009A==',key_name='tempest-keypair-410361526',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:35:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='130a3805426f42b69b24c50d02395db2',ramdisk_id='',reservation_id='r-4483v1jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1946604441',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1946604441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48d79d2923844f5ab8fab301ee9293ef',uuid=0bd209e9-b6c8-4663-a443-77d251b3d802,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Converting VIF {"id": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "address": "fa:16:3e:45:38:7c", "network": {"id": "fcf66f23-2c6d-4313-ac6f-2905af9164c5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-776924745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "130a3805426f42b69b24c50d02395db2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdb01ae-90", "ovs_interfaceid": "8cdb01ae-906f-4ff4-bc2c-2511cce726de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:38:7c,bridge_name='br-int',has_traffic_filtering=True,id=8cdb01ae-906f-4ff4-bc2c-2511cce726de,network=Network(fcf66f23-2c6d-4313-ac6f-2905af9164c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdb01ae-90') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG os_vif [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:38:7c,bridge_name='br-int',has_traffic_filtering=True,id=8cdb01ae-906f-4ff4-bc2c-2511cce726de,network=Network(fcf66f23-2c6d-4313-ac6f-2905af9164c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdb01ae-90') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cdb01ae-90, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c02c26e7-60ea-4233-a327-d71319aa4718) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:49 user nova-compute[75000]: INFO os_vif [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:38:7c,bridge_name='br-int',has_traffic_filtering=True,id=8cdb01ae-906f-4ff4-bc2c-2511cce726de,network=Network(fcf66f23-2c6d-4313-ac6f-2905af9164c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdb01ae-90')
Nov 06 22:40:49 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Deleting instance files /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802_del
Nov 06 22:40:49 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Deletion of /opt/stack/data/nova/instances/0bd209e9-b6c8-4663-a443-77d251b3d802_del complete
Nov 06 22:40:49 user nova-compute[75000]: INFO nova.compute.manager [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 06 22:40:49 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:40:49 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:40:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:51 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:51 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Took 1.86 seconds to deallocate network for instance.
Nov 06 22:40:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG nova.compute.manager [req-1b274d92-d0c5-4c98-9dc6-e6e59931a369 req-ae3810d0-f8f7-49b9-b17f-cdb7434ba851 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received event network-vif-plugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1b274d92-d0c5-4c98-9dc6-e6e59931a369 req-ae3810d0-f8f7-49b9-b17f-cdb7434ba851 service nova] Acquiring lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1b274d92-d0c5-4c98-9dc6-e6e59931a369 req-ae3810d0-f8f7-49b9-b17f-cdb7434ba851 service nova] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1b274d92-d0c5-4c98-9dc6-e6e59931a369 req-ae3810d0-f8f7-49b9-b17f-cdb7434ba851 service nova] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG nova.compute.manager [req-1b274d92-d0c5-4c98-9dc6-e6e59931a369 req-ae3810d0-f8f7-49b9-b17f-cdb7434ba851 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] No waiting events found dispatching network-vif-plugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:40:52 user nova-compute[75000]: WARNING nova.compute.manager [req-1b274d92-d0c5-4c98-9dc6-e6e59931a369 req-ae3810d0-f8f7-49b9-b17f-cdb7434ba851 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received unexpected event network-vif-plugged-8cdb01ae-906f-4ff4-bc2c-2511cce726de for instance with vm_state deleted and task_state None.
Nov 06 22:40:52 user nova-compute[75000]: DEBUG nova.compute.manager [req-1b274d92-d0c5-4c98-9dc6-e6e59931a369 req-ae3810d0-f8f7-49b9-b17f-cdb7434ba851 service nova] [instance: 0bd209e9-b6c8-4663-a443-77d251b3d802] Received event network-vif-deleted-8cdb01ae-906f-4ff4-bc2c-2511cce726de {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:52 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Deleted allocations for instance 0bd209e9-b6c8-4663-a443-77d251b3d802
Nov 06 22:40:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c44691a2-faa1-4164-949c-0dfe94949191 tempest-TestServerVolumeAttachmentScenario-1946604441 tempest-TestServerVolumeAttachmentScenario-1946604441-project-member] Lock "0bd209e9-b6c8-4663-a443-77d251b3d802" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.674s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQuTzEph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:40:52 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:40:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:40:52 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:40:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:40:52 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:40:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc965f2-ce53-4bbb-b50f-4ffba34f3ba1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:40:52 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.155s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dbc7b5-3650-48e7-853a-6ef70e3bd7d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2] added
Nov 06 22:40:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.098s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[213c117b-c230-4d07-98c4-c0aa7a3ccea4]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7db5ac-e51d-4aa2-8586-e31967026ef1]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQuTzEph {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQuTzEph" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e677853b-63b6-4334-970a-25a1d4d9553e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fQuTzEph'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[706c1407-d0f0-4dde-8891-689171cd7e4f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc284952-61c9-425d-88b2-c31386dc769e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fb4d89-8450-4f56-9e66-f07da2248442]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2, portal: 172.16.0.220,3260]
Nov 06 22:40:53 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2, portal: 172.16.0.220,3260] successful.
Nov 06 22:40:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ca4d85-c682-4e51-b528-e2ce697b7324]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80655129-2056-4ae3-b2ea-c99c470bd0bf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:40:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.557s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[04652653-70db-4c5e-94c5-da29514dbf64]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:40:53 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQuTzEph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.591s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] <== connect_volume: return (1593ms) {'type': 'block', 'scsi_wwn': '26430363830366235', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430363830366235', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'flavor' on Instance uuid fd2235fd-3b64-4ff2-8350-aa3a9b092ecd {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:40:54 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:40:54 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:40:54 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:40:54 user nova-compute[75000]:   <serial>908efb7e-e146-4c70-96fa-4816637579a2</serial>
Nov 06 22:40:54 user nova-compute[75000]: </disk>
Nov 06 22:40:54 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No VIF found with MAC fa:16:3e:47:ec:20, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:40:54 user nova-compute[75000]: DEBUG nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:40:55 user nova-compute[75000]: INFO nova.compute.claims [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Claim successful on node user
Nov 06 22:40:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0d475709-b48b-4e90-8ace-97e89731a1ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.444s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:40:55 user nova-compute[75000]: DEBUG nova.network.neutron [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:40:55 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:40:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG nova.policy [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27639ab7ae064eca9e2c1b23ded8a866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9412d5020f342499289d8ad48e19ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:40:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Creating image(s)
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk 1073741824" returned: 0 in 0.049s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG nova.network.neutron [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Successfully created port: 035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Cannot resize image /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Ensure instance console log exists: /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Successfully updated port: 035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquired lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-5b2d28e9-ad7e-422e-8cd2-68f84d8ea8d0 req-0d4ddfb5-5ab5-4e4d-a5ab-db82b3f9001d service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-changed-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-5b2d28e9-ad7e-422e-8cd2-68f84d8ea8d0 req-0d4ddfb5-5ab5-4e4d-a5ab-db82b3f9001d service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Refreshing instance network info cache due to event network-changed-035045a6-0a9c-4787-8776-876c1cb58343. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5b2d28e9-ad7e-422e-8cd2-68f84d8ea8d0 req-0d4ddfb5-5ab5-4e4d-a5ab-db82b3f9001d service nova] Acquiring lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updating instance_info_cache with network_info: [{"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Releasing lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance network_info: |[{"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5b2d28e9-ad7e-422e-8cd2-68f84d8ea8d0 req-0d4ddfb5-5ab5-4e4d-a5ab-db82b3f9001d service nova] Acquired lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.network.neutron [req-5b2d28e9-ad7e-422e-8cd2-68f84d8ea8d0 req-0d4ddfb5-5ab5-4e4d-a5ab-db82b3f9001d service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Refreshing network info cache for port 035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Start _get_guest_xml network_info=[{"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:40:57 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:40:57 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746831654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746831654',id=33,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPxX3LQJMq6tbA/hp/lkqOxna0KLgPcQgngOnf//5bF/+o23OPHaIMGxPh3RSWIaWtgEnV/1dtxkMDXBS8dkft0f4nQOiXD+EFnxP/eLWaTSQIwl2JuGfmafYMiyOjUOg==',key_name='tempest-keypair-1457495529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-06levmq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=f31ab346-0c23-4086-9c16-3322dc972c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'pci_devices' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:40:57 user nova-compute[75000]:   <uuid>f31ab346-0c23-4086-9c16-3322dc972c5f</uuid>
Nov 06 22:40:57 user nova-compute[75000]:   <name>instance-00000021</name>
Nov 06 22:40:57 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:40:57 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:40:57 user nova-compute[75000]:   <metadata>
Nov 06 22:40:57 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:40:57 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:40:57 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746831654</nova:name>
Nov 06 22:40:57 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:40:57</nova:creationTime>
Nov 06 22:40:57 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:40:57 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:40:57 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:40:57 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:40:57 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:40:57 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:40:57 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:40:57 user nova-compute[75000]:       <nova:owner>
Nov 06 22:40:57 user nova-compute[75000]:         <nova:user uuid="27639ab7ae064eca9e2c1b23ded8a866">tempest-AttachVolumeShelveTestJSON-346837560-project-member</nova:user>
Nov 06 22:40:57 user nova-compute[75000]:         <nova:project uuid="e9412d5020f342499289d8ad48e19ac4">tempest-AttachVolumeShelveTestJSON-346837560</nova:project>
Nov 06 22:40:57 user nova-compute[75000]:       </nova:owner>
Nov 06 22:40:57 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:40:57 user nova-compute[75000]:       <nova:ports>
Nov 06 22:40:57 user nova-compute[75000]:         <nova:port uuid="035045a6-0a9c-4787-8776-876c1cb58343">
Nov 06 22:40:57 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 22:40:57 user nova-compute[75000]:         </nova:port>
Nov 06 22:40:57 user nova-compute[75000]:       </nova:ports>
Nov 06 22:40:57 user nova-compute[75000]:     </nova:instance>
Nov 06 22:40:57 user nova-compute[75000]:   </metadata>
Nov 06 22:40:57 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:40:57 user nova-compute[75000]:     <system>
Nov 06 22:40:57 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:40:57 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:40:57 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:40:57 user nova-compute[75000]:       <entry name="serial">f31ab346-0c23-4086-9c16-3322dc972c5f</entry>
Nov 06 22:40:57 user nova-compute[75000]:       <entry name="uuid">f31ab346-0c23-4086-9c16-3322dc972c5f</entry>
Nov 06 22:40:57 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:40:57 user nova-compute[75000]:     </system>
Nov 06 22:40:57 user nova-compute[75000]:   </sysinfo>
Nov 06 22:40:57 user nova-compute[75000]:   <os>
Nov 06 22:40:57 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:40:57 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:40:57 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:40:57 user nova-compute[75000]:   </os>
Nov 06 22:40:57 user nova-compute[75000]:   <features>
Nov 06 22:40:57 user nova-compute[75000]:     <acpi/>
Nov 06 22:40:57 user nova-compute[75000]:     <apic/>
Nov 06 22:40:57 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:40:57 user nova-compute[75000]:   </features>
Nov 06 22:40:57 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:40:57 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:40:57 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:40:57 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:40:57 user nova-compute[75000]:   </clock>
Nov 06 22:40:57 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:40:57 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:40:57 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:40:57 user nova-compute[75000]:   </cpu>
Nov 06 22:40:57 user nova-compute[75000]:   <devices>
Nov 06 22:40:57 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:40:57 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:40:57 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk"/>
Nov 06 22:40:57 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:40:57 user nova-compute[75000]:     </disk>
Nov 06 22:40:57 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:40:57 user nova-compute[75000]:       <mac address="fa:16:3e:05:5e:74"/>
Nov 06 22:40:57 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:40:57 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:40:57 user nova-compute[75000]:       <target dev="tap035045a6-0a"/>
Nov 06 22:40:57 user nova-compute[75000]:     </interface>
Nov 06 22:40:57 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:40:57 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/console.log" append="off"/>
Nov 06 22:40:57 user nova-compute[75000]:     </serial>
Nov 06 22:40:57 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:40:57 user nova-compute[75000]:     <video>
Nov 06 22:40:57 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:40:57 user nova-compute[75000]:     </video>
Nov 06 22:40:57 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:40:57 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:40:57 user nova-compute[75000]:     </rng>
Nov 06 22:40:57 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:40:57 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:40:57 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:40:57 user nova-compute[75000]:     </memballoon>
Nov 06 22:40:57 user nova-compute[75000]:   </devices>
Nov 06 22:40:57 user nova-compute[75000]: </domain>
Nov 06 22:40:57 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746831654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746831654',id=33,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPxX3LQJMq6tbA/hp/lkqOxna0KLgPcQgngOnf//5bF/+o23OPHaIMGxPh3RSWIaWtgEnV/1dtxkMDXBS8dkft0f4nQOiXD+EFnxP/eLWaTSQIwl2JuGfmafYMiyOjUOg==',key_name='tempest-keypair-1457495529',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-06levmq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=f31ab346-0c23-4086-9c16-3322dc972c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG os_vif [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62c9c169-6fde-5731-a1c0-6dbde98b5bf9', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap035045a6-0a, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap035045a6-0a, col_values=(('qos', UUID('c302b3b2-56fd-401c-af44-dd5db4667bb3')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap035045a6-0a, col_values=(('external_ids', {'iface-id': '035045a6-0a9c-4787-8776-876c1cb58343', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:5e:74', 'vm-uuid': 'f31ab346-0c23-4086-9c16-3322dc972c5f'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:57 user nova-compute[75000]: INFO os_vif [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a')
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:40:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] No VIF found with MAC fa:16:3e:05:5e:74, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:40:58 user nova-compute[75000]: DEBUG nova.network.neutron [req-5b2d28e9-ad7e-422e-8cd2-68f84d8ea8d0 req-0d4ddfb5-5ab5-4e4d-a5ab-db82b3f9001d service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updated VIF entry in instance network info cache for port 035045a6-0a9c-4787-8776-876c1cb58343. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:40:58 user nova-compute[75000]: DEBUG nova.network.neutron [req-5b2d28e9-ad7e-422e-8cd2-68f84d8ea8d0 req-0d4ddfb5-5ab5-4e4d-a5ab-db82b3f9001d service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updating instance_info_cache with network_info: [{"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:40:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5b2d28e9-ad7e-422e-8cd2-68f84d8ea8d0 req-0d4ddfb5-5ab5-4e4d-a5ab-db82b3f9001d service nova] Releasing lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-1ffcc728-afdf-4638-8119-b4cdd98c3bc7 req-65595561-c41e-4887-9ba0-b6c4df7e41d3 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1ffcc728-afdf-4638-8119-b4cdd98c3bc7 req-65595561-c41e-4887-9ba0-b6c4df7e41d3 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1ffcc728-afdf-4638-8119-b4cdd98c3bc7 req-65595561-c41e-4887-9ba0-b6c4df7e41d3 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1ffcc728-afdf-4638-8119-b4cdd98c3bc7 req-65595561-c41e-4887-9ba0-b6c4df7e41d3 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-1ffcc728-afdf-4638-8119-b4cdd98c3bc7 req-65595561-c41e-4887-9ba0-b6c4df7e41d3 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:40:59 user nova-compute[75000]: WARNING nova.compute.manager [req-1ffcc728-afdf-4638-8119-b4cdd98c3bc7 req-65595561-c41e-4887-9ba0-b6c4df7e41d3 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state building and task_state spawning.
Nov 06 22:40:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:40:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:41:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance spawned successfully.
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-af812501-2453-4020-ac53-bcef026434bb req-d1e85e48-5e5e-4ebb-b365-0c359334fbc9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-af812501-2453-4020-ac53-bcef026434bb req-d1e85e48-5e5e-4ebb-b365-0c359334fbc9 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-af812501-2453-4020-ac53-bcef026434bb req-d1e85e48-5e5e-4ebb-b365-0c359334fbc9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-af812501-2453-4020-ac53-bcef026434bb req-d1e85e48-5e5e-4ebb-b365-0c359334fbc9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-af812501-2453-4020-ac53-bcef026434bb req-d1e85e48-5e5e-4ebb-b365-0c359334fbc9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:01 user nova-compute[75000]: WARNING nova.compute.manager [req-af812501-2453-4020-ac53-bcef026434bb req-d1e85e48-5e5e-4ebb-b365-0c359334fbc9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state building and task_state spawning.
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:41:01 user nova-compute[75000]: INFO nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 06 22:41:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:41:01 user nova-compute[75000]: INFO nova.compute.manager [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Took 6.60 seconds to build instance.
Nov 06 22:41:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-37083129-b48b-41a4-b0d8-858da116781f tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.723s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:05 user nova-compute[75000]: INFO nova.compute.manager [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Detaching volume f3f91e9f-303a-4569-893e-656bcd5dc075
Nov 06 22:41:05 user nova-compute[75000]: INFO nova.virt.block_device [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Attempting to driver detach volume f3f91e9f-303a-4569-893e-656bcd5dc075 from mountpoint /dev/vdb
Nov 06 22:41:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Attempting to detach device vdb from instance c06fdcaf-015a-4f5e-9907-c95d1a775141 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:41:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:41:05 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:41:05 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:41:05 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:41:05 user nova-compute[75000]:   <serial>f3f91e9f-303a-4569-893e-656bcd5dc075</serial>
Nov 06 22:41:05 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:41:05 user nova-compute[75000]: </disk>
Nov 06 22:41:05 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:41:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully detached device vdb from instance c06fdcaf-015a-4f5e-9907-c95d1a775141 from the persistent domain config.
Nov 06 22:41:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c06fdcaf-015a-4f5e-9907-c95d1a775141 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:41:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:41:05 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:41:05 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:41:05 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:41:05 user nova-compute[75000]:   <serial>f3f91e9f-303a-4569-893e-656bcd5dc075</serial>
Nov 06 22:41:05 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:41:05 user nova-compute[75000]: </disk>
Nov 06 22:41:05 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:41:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c06fdcaf-015a-4f5e-9907-c95d1a775141 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:41:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:10 user nova-compute[75000]: INFO nova.compute.manager [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Terminating instance
Nov 06 22:41:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-235227f7-2a25-4130-9e07-30845231325b req-9d04f444-aaa6-4127-8d1a-1acb24b6b3b9 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-unplugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-235227f7-2a25-4130-9e07-30845231325b req-9d04f444-aaa6-4127-8d1a-1acb24b6b3b9 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-235227f7-2a25-4130-9e07-30845231325b req-9d04f444-aaa6-4127-8d1a-1acb24b6b3b9 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-235227f7-2a25-4130-9e07-30845231325b req-9d04f444-aaa6-4127-8d1a-1acb24b6b3b9 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-235227f7-2a25-4130-9e07-30845231325b req-9d04f444-aaa6-4127-8d1a-1acb24b6b3b9 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-unplugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-235227f7-2a25-4130-9e07-30845231325b req-9d04f444-aaa6-4127-8d1a-1acb24b6b3b9 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-unplugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Instance destroyed successfully.
Nov 06 22:41:11 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'resources' on Instance uuid 3dfe6744-55ec-4294-8fda-5689879ed46b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-767875355',display_name='tempest-ServerRescueNegativeTestJSON-server-767875355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-767875355',id=24,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdTqiSrMqRl+yglj84awVX1hdMP+cCKbd7CLQXPSJ3xZ+8VIStP539jNk65vUlH6hoLPRWMdxprcJ8AVIS+526F1aYdGyOUIMI+uHEm3yCZPpspfjLampZy1EaJS8pbcg==',key_name='tempest-keypair-340254793',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:36:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-pifvb90z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f50e6a64752e488b9699a8bdda46253c',uuid=3dfe6744-55ec-4294-8fda-5689879ed46b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "address": "fa:16:3e:91:2e:d2", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d134985-3e", "ovs_interfaceid": "7d134985-3e0b-4352-a829-46cc9efcaaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:2e:d2,bridge_name='br-int',has_traffic_filtering=True,id=7d134985-3e0b-4352-a829-46cc9efcaaa3,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d134985-3e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG os_vif [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:2e:d2,bridge_name='br-int',has_traffic_filtering=True,id=7d134985-3e0b-4352-a829-46cc9efcaaa3,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d134985-3e') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d134985-3e, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbea7d17-fdec-43bb-8860-186899077ab9) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:11 user nova-compute[75000]: INFO os_vif [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:2e:d2,bridge_name='br-int',has_traffic_filtering=True,id=7d134985-3e0b-4352-a829-46cc9efcaaa3,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d134985-3e')
Nov 06 22:41:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Deleting instance files /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b_del
Nov 06 22:41:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Deletion of /opt/stack/data/nova/instances/3dfe6744-55ec-4294-8fda-5689879ed46b_del complete
Nov 06 22:41:11 user nova-compute[75000]: INFO nova.compute.manager [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 22:41:11 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:41:11 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:41:12 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:41:12 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Took 0.85 seconds to deallocate network for instance.
Nov 06 22:41:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:13 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:41:13 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:41:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:13 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Deleted allocations for instance 3dfe6744-55ec-4294-8fda-5689879ed46b
Nov 06 22:41:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4456d67a-e8e3-4076-8f32-9bc35ca922af tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.532s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-69d06240-46e1-44a8-958b-c1b725ad5f67 req-7c449d7a-7580-46af-88d4-bc60c4e92569 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-69d06240-46e1-44a8-958b-c1b725ad5f67 req-7c449d7a-7580-46af-88d4-bc60c4e92569 service nova] Acquiring lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-69d06240-46e1-44a8-958b-c1b725ad5f67 req-7c449d7a-7580-46af-88d4-bc60c4e92569 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-69d06240-46e1-44a8-958b-c1b725ad5f67 req-7c449d7a-7580-46af-88d4-bc60c4e92569 service nova] Lock "3dfe6744-55ec-4294-8fda-5689879ed46b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-69d06240-46e1-44a8-958b-c1b725ad5f67 req-7c449d7a-7580-46af-88d4-bc60c4e92569 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] No waiting events found dispatching network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:13 user nova-compute[75000]: WARNING nova.compute.manager [req-69d06240-46e1-44a8-958b-c1b725ad5f67 req-7c449d7a-7580-46af-88d4-bc60c4e92569 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received unexpected event network-vif-plugged-7d134985-3e0b-4352-a829-46cc9efcaaa3 for instance with vm_state deleted and task_state None.
Nov 06 22:41:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-69d06240-46e1-44a8-958b-c1b725ad5f67 req-7c449d7a-7580-46af-88d4-bc60c4e92569 service nova] [instance: 3dfe6744-55ec-4294-8fda-5689879ed46b] Received event network-vif-deleted-7d134985-3e0b-4352-a829-46cc9efcaaa3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG nova.objects.instance [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:19 user nova-compute[75000]: INFO nova.compute.manager [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attaching volume 0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 to /dev/vdb
Nov 06 22:41:19 user nova-compute[75000]: DEBUG os_brick.utils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bbd3c5-0bd5-4725-80e0-fd4e940fdc42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[26665f62-55ca-42e7-8a85-678de6f0720d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b120ce-5d3d-4715-a9c9-d0f1c4c99ae8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[345b9858-43e1-4ddf-b44e-ee9878418593]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:19 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:41:20 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:41:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7238c6-247a-44a4-9685-109a6c8395a5]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG os_brick.utils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating existing volume attachment record: 8b250c58-c602-45d6-8ee3-661d4bc8460d {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:41:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Starting finish_migration {{(pid=75000) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Instance directory exists: not creating {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 22:41:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Creating image(s)
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Ensure instance console log exists: /opt/stack/data/nova/instances/2ea4dcf9-775b-4f7c-8cac-0a325a74dc65/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Start _get_guest_xml network_info=[{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1437787295-network", "vif_mac": "fa:16:3e:61:00:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peNCnhEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2ea4dcf9-775b-4f7c-8cac-0a325a74dc65', 'attached_at': '2023-11-06T22:41:25.000000', 'detached_at': '', 'volume_id': 'e3b70ccb-55fe-46e6-8782-6913c98e0519', 'serial': 'e3b70ccb-55fe-46e6-8782-6913c98e0519'}, 'attachment_id': 'c973c22d-608f-4994-bb67-2b424ec4c2ed', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:41:24 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:41:24 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peNCnhEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:41:24 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:41:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:41:24 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:41:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:41:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:41:24 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde5188d-10c1-4572-b72a-7774be1a835f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:41:25 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc06ebd-ab28-477d-a512-b2043a5e9f4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519] added
Nov 06 22:41:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a63bf-5983-471f-b7c0-6a20d49a98bb]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0f25b1-13c9-45c7-919c-5f2b251cc9d9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peNCnhEY {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v peNCnhEY" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce600a1e-3f33-42f5-9a1d-1ebad6c6b3de]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'peNCnhEY'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8ca7b9-0f05-49e9-86c3-5817d1d2f5dc]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b10e3-90eb-4860-a998-ca5c30f363c7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a008e2c2-1654-4729-9f91-dfaaf3807801]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260]
Nov 06 22:41:25 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260] successful.
Nov 06 22:41:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2162f028-ed89-4661-9352-949ecbb0f032]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b7a1a3-9227-45d9-a7fe-b11cabd78203]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc45abf4-de72-43bc-b9dc-3d498f4683b9]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquired lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG nova.network.neutron [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'info_cache' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:25 user nova-compute[75000]: DEBUG nova.objects.base [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updating instance_info_cache with network_info: [{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Releasing lock "refresh_cache-16b393b8-83f7-4a36-9de2-f8c230c94be5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:41:26 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance destroyed successfully.
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'resources' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.base [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953138957',display_name='tempest-AttachVolumeTestJSON-server-1953138957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953138957',id=21,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKYUG+wX+Oy+5ZoCKABFPtVTS7CC7ezeu/QxRZrCFggdt3WxIBlw/f9Sjy6ccYGHltY5PMTkclfZi01PiCR7pnVT8WAyKEH2jdwmIpQmqFPlb4e6rSMVTU80G2v7DaTuQ==',key_name='tempest-keypair-458501348',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-r3alv0me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=16b393b8-83f7-4a36-9de2-f8c230c94be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_vif [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78f02e5b-8e, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c17e7ece-a7c9-4834-a4e8-7441172e2a94) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:41:26 user nova-compute[75000]: INFO os_vif [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e')
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Start _get_guest_xml network_info=[{"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'numa_topology' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.base [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:41:26 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:41:26 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peNCnhEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26562396364323933', 'path': '/dev/sdd'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562396364323933', 'path': '/dev/sdd'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.base [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953138957',display_name='tempest-AttachVolumeTestJSON-server-1953138957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953138957',id=21,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKYUG+wX+Oy+5ZoCKABFPtVTS7CC7ezeu/QxRZrCFggdt3WxIBlw/f9Sjy6ccYGHltY5PMTkclfZi01PiCR7pnVT8WAyKEH2jdwmIpQmqFPlb4e6rSMVTU80G2v7DaTuQ==',key_name='tempest-keypair-458501348',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-r3alv0me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=16b393b8-83f7-4a36-9de2-f8c230c94be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'pci_devices' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1148922530',display_name='tempest-ServerActionsTestOtherA-server-1148922530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1148922530',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWWSt8DqD1UiX7y0P2zcc1XaSgfLqWPMHCsT4qhuCpJN/KYahOdMyvjBaIfA8wTAtF3OG7T0GjKSjZNjN+adINTC3kMpTN5nU53yfK9kl9yrZK3oIAKJYF1R8Z+Truelg==',key_name='tempest-keypair-832438895',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-g4bey4gp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=2ea4dcf9-775b-4f7c-8cac-0a325a74dc65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1437787295-network", "vif_mac": "fa:16:3e:61:00:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1437787295-network", "vif_mac": "fa:16:3e:61:00:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:41:26 user nova-compute[75000]:   <uuid>2ea4dcf9-775b-4f7c-8cac-0a325a74dc65</uuid>
Nov 06 22:41:26 user nova-compute[75000]:   <name>instance-00000020</name>
Nov 06 22:41:26 user nova-compute[75000]:   <memory>2097152</memory>
Nov 06 22:41:26 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:41:26 user nova-compute[75000]:   <metadata>
Nov 06 22:41:26 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:41:26 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:name>tempest-ServerActionsTestOtherA-server-1148922530</nova:name>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:41:24</nova:creationTime>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:flavor name="m1.small">
Nov 06 22:41:26 user nova-compute[75000]:         <nova:memory>2048</nova:memory>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:disk>20</nova:disk>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:41:26 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:owner>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:user uuid="c6b8ec49509748aab2ab06755faf2a2d">tempest-ServerActionsTestOtherA-287714099-project-member</nova:user>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:project uuid="c931a6fc1f8a405f83293c6685dc016e">tempest-ServerActionsTestOtherA-287714099</nova:project>
Nov 06 22:41:26 user nova-compute[75000]:       </nova:owner>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:ports>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:port uuid="813e48da-0008-4864-9dbd-002434796b1a">
Nov 06 22:41:26 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:41:26 user nova-compute[75000]:         </nova:port>
Nov 06 22:41:26 user nova-compute[75000]:       </nova:ports>
Nov 06 22:41:26 user nova-compute[75000]:     </nova:instance>
Nov 06 22:41:26 user nova-compute[75000]:   </metadata>
Nov 06 22:41:26 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:41:26 user nova-compute[75000]:     <system>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="serial">2ea4dcf9-775b-4f7c-8cac-0a325a74dc65</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="uuid">2ea4dcf9-775b-4f7c-8cac-0a325a74dc65</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:41:26 user nova-compute[75000]:     </system>
Nov 06 22:41:26 user nova-compute[75000]:   </sysinfo>
Nov 06 22:41:26 user nova-compute[75000]:   <os>
Nov 06 22:41:26 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:41:26 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:41:26 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:41:26 user nova-compute[75000]:   </os>
Nov 06 22:41:26 user nova-compute[75000]:   <features>
Nov 06 22:41:26 user nova-compute[75000]:     <acpi/>
Nov 06 22:41:26 user nova-compute[75000]:     <apic/>
Nov 06 22:41:26 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:41:26 user nova-compute[75000]:   </features>
Nov 06 22:41:26 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:41:26 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:41:26 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:41:26 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:41:26 user nova-compute[75000]:   </clock>
Nov 06 22:41:26 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:41:26 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:41:26 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:41:26 user nova-compute[75000]:   </cpu>
Nov 06 22:41:26 user nova-compute[75000]:   <devices>
Nov 06 22:41:26 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:41:26 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:41:26 user nova-compute[75000]:       <source dev="/dev/sdd"/>
Nov 06 22:41:26 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:41:26 user nova-compute[75000]:       <serial>e3b70ccb-55fe-46e6-8782-6913c98e0519</serial>
Nov 06 22:41:26 user nova-compute[75000]:     </disk>
Nov 06 22:41:26 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:41:26 user nova-compute[75000]:       <mac address="fa:16:3e:61:00:b1"/>
Nov 06 22:41:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:41:26 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:41:26 user nova-compute[75000]:       <target dev="tap813e48da-00"/>
Nov 06 22:41:26 user nova-compute[75000]:     </interface>
Nov 06 22:41:26 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:41:26 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/2ea4dcf9-775b-4f7c-8cac-0a325a74dc65/console.log" append="off"/>
Nov 06 22:41:26 user nova-compute[75000]:     </serial>
Nov 06 22:41:26 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:41:26 user nova-compute[75000]:     <video>
Nov 06 22:41:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:41:26 user nova-compute[75000]:     </video>
Nov 06 22:41:26 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:41:26 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:41:26 user nova-compute[75000]:     </rng>
Nov 06 22:41:26 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:41:26 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:41:26 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:41:26 user nova-compute[75000]:     </memballoon>
Nov 06 22:41:26 user nova-compute[75000]:   </devices>
Nov 06 22:41:26 user nova-compute[75000]: </domain>
Nov 06 22:41:26 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1148922530',display_name='tempest-ServerActionsTestOtherA-server-1148922530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1148922530',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWWSt8DqD1UiX7y0P2zcc1XaSgfLqWPMHCsT4qhuCpJN/KYahOdMyvjBaIfA8wTAtF3OG7T0GjKSjZNjN+adINTC3kMpTN5nU53yfK9kl9yrZK3oIAKJYF1R8Z+Truelg==',key_name='tempest-keypair-832438895',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-g4bey4gp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:40:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=2ea4dcf9-775b-4f7c-8cac-0a325a74dc65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1437787295-network", "vif_mac": "fa:16:3e:61:00:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1437787295-network", "vif_mac": "fa:16:3e:61:00:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_vif [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:41:26 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c06fdcaf-015a-4f5e-9907-c95d1a775141 is timed out.
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.base [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:41:26 user nova-compute[75000]:   <uuid>16b393b8-83f7-4a36-9de2-f8c230c94be5</uuid>
Nov 06 22:41:26 user nova-compute[75000]:   <name>instance-00000015</name>
Nov 06 22:41:26 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:41:26 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:41:26 user nova-compute[75000]:   <metadata>
Nov 06 22:41:26 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:41:26 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeTestJSON-server-1953138957</nova:name>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:41:26</nova:creationTime>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:41:26 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:41:26 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:owner>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:user uuid="9adf42a2f6ae4b83900ab310933a6421">tempest-AttachVolumeTestJSON-738638018-project-member</nova:user>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:project uuid="425b4940d7904d58982aae5a883fc3ed">tempest-AttachVolumeTestJSON-738638018</nova:project>
Nov 06 22:41:26 user nova-compute[75000]:       </nova:owner>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:41:26 user nova-compute[75000]:       <nova:ports>
Nov 06 22:41:26 user nova-compute[75000]:         <nova:port uuid="78f02e5b-8e34-4d73-907b-c49095cc8147">
Nov 06 22:41:26 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:41:26 user nova-compute[75000]:         </nova:port>
Nov 06 22:41:26 user nova-compute[75000]:       </nova:ports>
Nov 06 22:41:26 user nova-compute[75000]:     </nova:instance>
Nov 06 22:41:26 user nova-compute[75000]:   </metadata>
Nov 06 22:41:26 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:41:26 user nova-compute[75000]:     <system>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="serial">16b393b8-83f7-4a36-9de2-f8c230c94be5</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="uuid">16b393b8-83f7-4a36-9de2-f8c230c94be5</entry>
Nov 06 22:41:26 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:41:26 user nova-compute[75000]:     </system>
Nov 06 22:41:26 user nova-compute[75000]:   </sysinfo>
Nov 06 22:41:26 user nova-compute[75000]:   <os>
Nov 06 22:41:26 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:41:26 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:41:26 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:41:26 user nova-compute[75000]:   </os>
Nov 06 22:41:26 user nova-compute[75000]:   <features>
Nov 06 22:41:26 user nova-compute[75000]:     <acpi/>
Nov 06 22:41:26 user nova-compute[75000]:     <apic/>
Nov 06 22:41:26 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:41:26 user nova-compute[75000]:   </features>
Nov 06 22:41:26 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:41:26 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:41:26 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:41:26 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:41:26 user nova-compute[75000]:   </clock>
Nov 06 22:41:26 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:41:26 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:41:26 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:41:26 user nova-compute[75000]:   </cpu>
Nov 06 22:41:26 user nova-compute[75000]:   <devices>
Nov 06 22:41:26 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:41:26 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:41:26 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk"/>
Nov 06 22:41:26 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:41:26 user nova-compute[75000]:     </disk>
Nov 06 22:41:26 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:41:26 user nova-compute[75000]:       <mac address="fa:16:3e:a0:b0:4e"/>
Nov 06 22:41:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:41:26 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:41:26 user nova-compute[75000]:       <target dev="tap78f02e5b-8e"/>
Nov 06 22:41:26 user nova-compute[75000]:     </interface>
Nov 06 22:41:26 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:41:26 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/console.log" append="off"/>
Nov 06 22:41:26 user nova-compute[75000]:     </serial>
Nov 06 22:41:26 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:41:26 user nova-compute[75000]:     <video>
Nov 06 22:41:26 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:41:26 user nova-compute[75000]:     </video>
Nov 06 22:41:26 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:41:26 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:41:26 user nova-compute[75000]:     </rng>
Nov 06 22:41:26 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:41:26 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:41:26 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:41:26 user nova-compute[75000]:     </memballoon>
Nov 06 22:41:26 user nova-compute[75000]:   </devices>
Nov 06 22:41:26 user nova-compute[75000]: </domain>
Nov 06 22:41:26 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aef1fde4-72b7-582d-ac20-19f4c7bd84e1', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:26 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully detached device vdb from instance c06fdcaf-015a-4f5e-9907-c95d1a775141 from the live domain config.
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrOJBzxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:41:26 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap813e48da-00, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap813e48da-00, col_values=(('qos', UUID('4db1c550-796c-4ab3-86b9-fd095db51d1e')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap813e48da-00, col_values=(('external_ids', {'iface-id': '813e48da-0008-4864-9dbd-002434796b1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:00:b1', 'vm-uuid': '2ea4dcf9-775b-4f7c-8cac-0a325a74dc65'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:26 user nova-compute[75000]: INFO os_vif [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00')
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1858f9ed-885e-4e09-9311-91b334b97ded]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:41:26 user nova-compute[75000]: No targets found.
Nov 06 22:41:26 user nova-compute[75000]: iSNS:
Nov 06 22:41:26 user nova-compute[75000]: No targets found.
Nov 06 22:41:26 user nova-compute[75000]: STATIC:
Nov 06 22:41:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:41:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:41:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:41:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:41:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:41:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:41:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075
Nov 06 22:41:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:41:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:41:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:41:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:41:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:41:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2
Nov 06 22:41:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:41:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:41:26 user nova-compute[75000]: FIRMWARE:
Nov 06 22:41:26 user nova-compute[75000]: No targets found.
Nov 06 22:41:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:41:26 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:41:26 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baef9eb-0bc3-4a19-aef3-1f95d7080b05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ab623d-70d6-4dfc-9aed-9d5aae6997da]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:41:26 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:26 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:26 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:41:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 (non-flash)
Nov 06 22:41:26 user nova-compute[75000]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:26 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:26 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:41:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc148550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075'): ({'sde'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Removing single pathed devices sde {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9d88c3-e6ba-44c2-a7a2-c793f32ef910]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9f4134-8e65-4517-9774-a593dc9e9aa2]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flushing IO for device /dev/sde {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] No VIF found with MAC fa:16:3e:61:00:b1, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89b4434-b264-4230-a62d-a99d8b4c6e8a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[706beacf-12d2-424f-b044-e222e89e5108]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8477ba-8cbb-4d87-abc3-3964db558433]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.objects.base [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3902a0-2f26-4d71-8430-0c031b75229c]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075, portal: 172.16.0.220,3260]
Nov 06 22:41:26 user nova-compute[75000]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075, portal: 172.16.0.220,3260] successful.
Nov 06 22:41:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3f91e9f-303a-4569-893e-656bcd5dc075 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[399a62d3-ca47-41e9-a35a-242354265cd1]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] <== disconnect_volume: return (438ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:41:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Cannot resize image /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG nova.objects.instance [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'migration_context' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG nova.objects.base [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Object Instance<16b393b8-83f7-4a36-9de2-f8c230c94be5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953138957',display_name='tempest-AttachVolumeTestJSON-server-1953138957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953138957',id=21,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKYUG+wX+Oy+5ZoCKABFPtVTS7CC7ezeu/QxRZrCFggdt3WxIBlw/f9Sjy6ccYGHltY5PMTkclfZi01PiCR7pnVT8WAyKEH2jdwmIpQmqFPlb4e6rSMVTU80G2v7DaTuQ==',key_name='tempest-keypair-458501348',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-r3alv0me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=16b393b8-83f7-4a36-9de2-f8c230c94be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG os_vif [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '442fe7f0-a6f0-54e3-85ee-c3679aceb66c', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78f02e5b-8e, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78f02e5b-8e, col_values=(('qos', UUID('2d322658-99ca-44a3-ae5c-5e4da7044928')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78f02e5b-8e, col_values=(('external_ids', {'iface-id': '78f02e5b-8e34-4d73-907b-c49095cc8147', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:b0:4e', 'vm-uuid': '16b393b8-83f7-4a36-9de2-f8c230c94be5'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:41:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:27 user nova-compute[75000]: INFO os_vif [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e')
Nov 06 22:41:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-a1f2015b-06e6-4d63-b100-d6c02142fb25 req-7b531b7b-fa5c-4ac1-97ff-b19e7197e61d service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a1f2015b-06e6-4d63-b100-d6c02142fb25 req-7b531b7b-fa5c-4ac1-97ff-b19e7197e61d service nova] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a1f2015b-06e6-4d63-b100-d6c02142fb25 req-7b531b7b-fa5c-4ac1-97ff-b19e7197e61d service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a1f2015b-06e6-4d63-b100-d6c02142fb25 req-7b531b7b-fa5c-4ac1-97ff-b19e7197e61d service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-a1f2015b-06e6-4d63-b100-d6c02142fb25 req-7b531b7b-fa5c-4ac1-97ff-b19e7197e61d service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] No waiting events found dispatching network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:28 user nova-compute[75000]: WARNING nova.compute.manager [req-a1f2015b-06e6-4d63-b100-d6c02142fb25 req-7b531b7b-fa5c-4ac1-97ff-b19e7197e61d service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received unexpected event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a for instance with vm_state active and task_state resize_finish.
Nov 06 22:41:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-3fbe9d5a-6e4a-4788-a97a-e657540d6926 req-a6e522ef-7c91-446d-ac3a-dfcde2586937 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3fbe9d5a-6e4a-4788-a97a-e657540d6926 req-a6e522ef-7c91-446d-ac3a-dfcde2586937 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3fbe9d5a-6e4a-4788-a97a-e657540d6926 req-a6e522ef-7c91-446d-ac3a-dfcde2586937 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3fbe9d5a-6e4a-4788-a97a-e657540d6926 req-a6e522ef-7c91-446d-ac3a-dfcde2586937 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-3fbe9d5a-6e4a-4788-a97a-e657540d6926 req-a6e522ef-7c91-446d-ac3a-dfcde2586937 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:30 user nova-compute[75000]: WARNING nova.compute.manager [req-3fbe9d5a-6e4a-4788-a97a-e657540d6926 req-a6e522ef-7c91-446d-ac3a-dfcde2586937 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state stopped and task_state powering-on.
Nov 06 22:41:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-0cd49ea9-58ff-432b-924d-9b98e0b75397 req-b87aa397-e26a-48c2-abf2-18b6a8b7f5cc service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0cd49ea9-58ff-432b-924d-9b98e0b75397 req-b87aa397-e26a-48c2-abf2-18b6a8b7f5cc service nova] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0cd49ea9-58ff-432b-924d-9b98e0b75397 req-b87aa397-e26a-48c2-abf2-18b6a8b7f5cc service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0cd49ea9-58ff-432b-924d-9b98e0b75397 req-b87aa397-e26a-48c2-abf2-18b6a8b7f5cc service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-0cd49ea9-58ff-432b-924d-9b98e0b75397 req-b87aa397-e26a-48c2-abf2-18b6a8b7f5cc service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] No waiting events found dispatching network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:30 user nova-compute[75000]: WARNING nova.compute.manager [req-0cd49ea9-58ff-432b-924d-9b98e0b75397 req-b87aa397-e26a-48c2-abf2-18b6a8b7f5cc service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received unexpected event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a for instance with vm_state active and task_state resize_finish.
Nov 06 22:41:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:41:32 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Instance running successfully.
Nov 06 22:41:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Failed to set time: agent not configured {{(pid=75000) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 06 22:41:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5159b27c-7f7c-4dd4-ad61-9aaac3cf3dac tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] finish_migration finished successfully. {{(pid=75000) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 06 22:41:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-09b17969-77aa-4c10-981c-b624b59ef7eb req-63c2401b-142b-412d-a073-610b17c35bb8 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-09b17969-77aa-4c10-981c-b624b59ef7eb req-63c2401b-142b-412d-a073-610b17c35bb8 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-09b17969-77aa-4c10-981c-b624b59ef7eb req-63c2401b-142b-412d-a073-610b17c35bb8 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-09b17969-77aa-4c10-981c-b624b59ef7eb req-63c2401b-142b-412d-a073-610b17c35bb8 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:32 user nova-compute[75000]: DEBUG nova.compute.manager [req-09b17969-77aa-4c10-981c-b624b59ef7eb req-63c2401b-142b-412d-a073-610b17c35bb8 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:32 user nova-compute[75000]: WARNING nova.compute.manager [req-09b17969-77aa-4c10-981c-b624b59ef7eb req-63c2401b-142b-412d-a073-610b17c35bb8 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state stopped and task_state powering-on.
Nov 06 22:41:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:41:32 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance rebooted successfully.
Nov 06 22:41:32 user nova-compute[75000]: DEBUG nova.compute.manager [None req-019b7931-92f3-4ad4-a3db-4037b887292b tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:41:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'flavor' on Instance uuid c06fdcaf-015a-4f5e-9907-c95d1a775141 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a41c10d2-1a6a-43d8-b33b-5d3cec7e9e21 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.162s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:37 user nova-compute[75000]: INFO nova.compute.manager [None req-882977b7-542b-4160-8561-c52885a5296d tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Unrescuing
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-882977b7-542b-4160-8561-c52885a5296d tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-882977b7-542b-4160-8561-c52885a5296d tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquired lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-882977b7-542b-4160-8561-c52885a5296d tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-882977b7-542b-4160-8561-c52885a5296d tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Updating instance_info_cache with network_info: [{"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-882977b7-542b-4160-8561-c52885a5296d tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Releasing lock "refresh_cache-b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG nova.objects.instance [None req-882977b7-542b-4160-8561-c52885a5296d tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'flavor' on Instance uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-a894bf59-0e32-4aa3-a80b-86f541594684 req-6960de10-c681-4bff-b01c-4c7091ab60f4 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-unplugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a894bf59-0e32-4aa3-a80b-86f541594684 req-6960de10-c681-4bff-b01c-4c7091ab60f4 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a894bf59-0e32-4aa3-a80b-86f541594684 req-6960de10-c681-4bff-b01c-4c7091ab60f4 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a894bf59-0e32-4aa3-a80b-86f541594684 req-6960de10-c681-4bff-b01c-4c7091ab60f4 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-a894bf59-0e32-4aa3-a80b-86f541594684 req-6960de10-c681-4bff-b01c-4c7091ab60f4 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-unplugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:38 user nova-compute[75000]: WARNING nova.compute.manager [req-a894bf59-0e32-4aa3-a80b-86f541594684 req-6960de10-c681-4bff-b01c-4c7091ab60f4 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-unplugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:41:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue --force-share --output=json" returned: 0 in 0.264s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:39 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Instance destroyed successfully.
Nov 06 22:41:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-cc223c51-14ac-48f7-91c6-9b4f773757dd req-fb4bc310-e79d-43b8-b3aa-54f0b3139683 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cc223c51-14ac-48f7-91c6-9b4f773757dd req-fb4bc310-e79d-43b8-b3aa-54f0b3139683 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cc223c51-14ac-48f7-91c6-9b4f773757dd req-fb4bc310-e79d-43b8-b3aa-54f0b3139683 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cc223c51-14ac-48f7-91c6-9b4f773757dd req-fb4bc310-e79d-43b8-b3aa-54f0b3139683 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-cc223c51-14ac-48f7-91c6-9b4f773757dd req-fb4bc310-e79d-43b8-b3aa-54f0b3139683 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:40 user nova-compute[75000]: WARNING nova.compute.manager [req-cc223c51-14ac-48f7-91c6-9b4f773757dd req-fb4bc310-e79d-43b8-b3aa-54f0b3139683 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:41:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.manager [None req-882977b7-542b-4160-8561-c52885a5296d tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:44 user nova-compute[75000]: WARNING nova.compute.manager [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:44 user nova-compute[75000]: WARNING nova.compute.manager [req-822610cb-d6d7-48ba-92a2-24be333e8acc req-4ed3b8cb-df86-46ae-a0e5-e4db00e4a511 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:41:44 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:41:44 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7493MB free_disk=24.898178100585938GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Applying migration context for instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 as it has an incoming, in-progress migration c9f4aeed-1861-426f-95b6-bf092c779e85. Migration status is finished {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 22:41:44 user nova-compute[75000]: INFO nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating resource usage from migration c9f4aeed-1861-426f-95b6-bf092c779e85
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c06fdcaf-015a-4f5e-9907-c95d1a775141 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b06e5a39-e167-40c6-80a8-d70ca8e0ec7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Migration c9f4aeed-1861-426f-95b6-bf092c779e85 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f31ab346-0c23-4086-9c16-3322dc972c5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 22:41:44 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 22:41:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:45 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:41:45 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:41:45 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:41:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.341s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 22:41:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 22:41:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:41:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:41:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:41:46 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updating instance_info_cache with network_info: [{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:47 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:41:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid bf3bafdf-dba5-4961-a891-98f522b27f53 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 97e834ec-a286-4da9-a6b8-164a1061f042 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 9e161f93-64e3-4807-8811-d7d6ba821ca9 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid c06fdcaf-015a-4f5e-9907-c95d1a775141 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid fd2235fd-3b64-4ff2-8350-aa3a9b092ecd {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "97e834ec-a286-4da9-a6b8-164a1061f042" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "97e834ec-a286-4da9-a6b8-164a1061f042" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "9e161f93-64e3-4807-8811-d7d6ba821ca9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "97e834ec-a286-4da9-a6b8-164a1061f042" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:56 user nova-compute[75000]: INFO nova.compute.manager [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Terminating instance
Nov 06 22:41:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-9d67b481-6588-47c4-a29d-ed2f4049c5fd req-ae2e60c2-912c-4c12-8ca7-5009cf4286a1 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received event network-vif-unplugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9d67b481-6588-47c4-a29d-ed2f4049c5fd req-ae2e60c2-912c-4c12-8ca7-5009cf4286a1 service nova] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9d67b481-6588-47c4-a29d-ed2f4049c5fd req-ae2e60c2-912c-4c12-8ca7-5009cf4286a1 service nova] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9d67b481-6588-47c4-a29d-ed2f4049c5fd req-ae2e60c2-912c-4c12-8ca7-5009cf4286a1 service nova] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-9d67b481-6588-47c4-a29d-ed2f4049c5fd req-ae2e60c2-912c-4c12-8ca7-5009cf4286a1 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] No waiting events found dispatching network-vif-unplugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-9d67b481-6588-47c4-a29d-ed2f4049c5fd req-ae2e60c2-912c-4c12-8ca7-5009cf4286a1 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received event network-vif-unplugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:41:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Instance destroyed successfully.
Nov 06 22:41:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'resources' on Instance uuid c06fdcaf-015a-4f5e-9907-c95d1a775141 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:35:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-805775064',display_name='tempest-AttachVolumeNegativeTest-server-805775064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-805775064',id=27,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIDtXdy1OBsBr8wMrswpfKMGLt3e2x2jlTrE7ss/D7h58uBYmvVfnraw8HHbSezuJ+lYMe8owPZlhv9+GoqOEylGJbjPufHZNvzTJPT0bELSGq1esbEDsfWw6rYSx3Zsg==',key_name='tempest-keypair-684394860',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-6z8sc9cy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=c06fdcaf-015a-4f5e-9907-c95d1a775141,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "address": "fa:16:3e:48:51:e5", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e57c36-87", "ovs_interfaceid": "26e57c36-87d2-49f8-9d8b-1d3436e3a7d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:51:e5,bridge_name='br-int',has_traffic_filtering=True,id=26e57c36-87d2-49f8-9d8b-1d3436e3a7d0,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e57c36-87') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG os_vif [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:51:e5,bridge_name='br-int',has_traffic_filtering=True,id=26e57c36-87d2-49f8-9d8b-1d3436e3a7d0,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e57c36-87') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26e57c36-87, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75cd91c0-522a-497f-b8e8-0a51bdd8cab3) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:41:57 user nova-compute[75000]: INFO os_vif [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:51:e5,bridge_name='br-int',has_traffic_filtering=True,id=26e57c36-87d2-49f8-9d8b-1d3436e3a7d0,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e57c36-87')
Nov 06 22:41:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Deleting instance files /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141_del
Nov 06 22:41:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Deletion of /opt/stack/data/nova/instances/c06fdcaf-015a-4f5e-9907-c95d1a775141_del complete
Nov 06 22:41:57 user nova-compute[75000]: INFO nova.compute.manager [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 06 22:41:57 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:41:57 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:41:58 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Took 1.05 seconds to deallocate network for instance.
Nov 06 22:41:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c2ef5e1-f80e-408d-a8a7-4e14ae501c6a req-3958e7cf-0426-4752-ac05-9162b8de1cd0 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received event network-vif-deleted-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:58 user nova-compute[75000]: INFO nova.compute.manager [req-2c2ef5e1-f80e-408d-a8a7-4e14ae501c6a req-3958e7cf-0426-4752-ac05-9162b8de1cd0 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Neutron deleted interface 26e57c36-87d2-49f8-9d8b-1d3436e3a7d0; detaching it from the instance and deleting it from the info cache
Nov 06 22:41:58 user nova-compute[75000]: DEBUG nova.network.neutron [req-2c2ef5e1-f80e-408d-a8a7-4e14ae501c6a req-3958e7cf-0426-4752-ac05-9162b8de1cd0 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c2ef5e1-f80e-408d-a8a7-4e14ae501c6a req-3958e7cf-0426-4752-ac05-9162b8de1cd0 service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Detach interface failed, port_id=26e57c36-87d2-49f8-9d8b-1d3436e3a7d0, reason: Instance c06fdcaf-015a-4f5e-9907-c95d1a775141 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-da4f524a-f2c6-4f82-88ab-a189e497f66a req-da8ae89e-0714-4b6f-bb6f-91e93040742d service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received event network-vif-plugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-da4f524a-f2c6-4f82-88ab-a189e497f66a req-da8ae89e-0714-4b6f-bb6f-91e93040742d service nova] Acquiring lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-da4f524a-f2c6-4f82-88ab-a189e497f66a req-da8ae89e-0714-4b6f-bb6f-91e93040742d service nova] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-da4f524a-f2c6-4f82-88ab-a189e497f66a req-da8ae89e-0714-4b6f-bb6f-91e93040742d service nova] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-da4f524a-f2c6-4f82-88ab-a189e497f66a req-da8ae89e-0714-4b6f-bb6f-91e93040742d service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] No waiting events found dispatching network-vif-plugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:41:58 user nova-compute[75000]: WARNING nova.compute.manager [req-da4f524a-f2c6-4f82-88ab-a189e497f66a req-da8ae89e-0714-4b6f-bb6f-91e93040742d service nova] [instance: c06fdcaf-015a-4f5e-9907-c95d1a775141] Received unexpected event network-vif-plugged-26e57c36-87d2-49f8-9d8b-1d3436e3a7d0 for instance with vm_state deleted and task_state None.
Nov 06 22:41:58 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:41:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:58 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Deleted allocations for instance c06fdcaf-015a-4f5e-9907-c95d1a775141
Nov 06 22:41:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0cdc6aa0-9527-43ef-afba-db08671f370a tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "c06fdcaf-015a-4f5e-9907-c95d1a775141" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.757s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGDZKmIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:41:59 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:41:59 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:41:59 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8b0873-2a7b-40e8-8acc-31ef3b04641d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:41:59 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbff05b-7b2e-4a9b-83a7-06b4f35dce02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10] added
Nov 06 22:41:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d8a5b-f956-456f-9395-74dd47d9d53d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da57bf-fb5c-43b7-b1e3-36f822f1c2ea]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PGDZKmIo {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PGDZKmIo" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81574ce-92ae-4556-b168-eaecd4c0a060]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PGDZKmIo'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6421d52-87a5-4c05-a69e-552f51c21d77]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d0d3ba-ece4-4f77-8588-03ceb5680790]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e0a71-6421-407c-a287-51396b5b62a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10, portal: 172.16.0.220,3260]
Nov 06 22:41:59 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10, portal: 172.16.0.220,3260] successful.
Nov 06 22:41:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e984439-43bf-44df-9fc9-16ec3f6d877a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[936720a9-ff47-4d4d-877e-9d23369f210e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:41:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7d59b0-d995-4773-aa36-a0885e2008b4]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:41:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGDZKmIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:42:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:42:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23763383233613463', 'path': '/dev/sde'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:42:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763383233613463', 'path': '/dev/sde'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:42:00 user nova-compute[75000]: DEBUG nova.objects.instance [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:42:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:42:00 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:42:00 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:42:00 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:42:00 user nova-compute[75000]:   <serial>0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10</serial>
Nov 06 22:42:00 user nova-compute[75000]: </disk>
Nov 06 22:42:00 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:42:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:42:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:42:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No VIF found with MAC fa:16:3e:a2:a0:8b, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:42:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-639578da-5934-4a7d-8196-da9cdaf3c84a tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.644s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.143s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:04 user nova-compute[75000]: INFO nova.compute.manager [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Detaching volume 0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10
Nov 06 22:42:04 user nova-compute[75000]: INFO nova.virt.block_device [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attempting to driver detach volume 0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 from mountpoint /dev/vdb
Nov 06 22:42:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Attempting to detach device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:42:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:42:04 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:42:04 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:42:04 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:42:04 user nova-compute[75000]:   <serial>0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10</serial>
Nov 06 22:42:04 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:42:04 user nova-compute[75000]: </disk>
Nov 06 22:42:04 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:42:04 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully detached device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the persistent domain config.
Nov 06 22:42:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:42:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:42:04 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:42:04 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:42:04 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:42:04 user nova-compute[75000]:   <serial>0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10</serial>
Nov 06 22:42:04 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:42:04 user nova-compute[75000]: </disk>
Nov 06 22:42:04 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:42:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:42:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:24 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb is timed out.
Nov 06 22:42:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully detached device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the live domain config.
Nov 06 22:42:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PGDZKmIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:42:24 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a39781-dc9a-42fa-a2ac-6dbaf8d738ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:42:24 user nova-compute[75000]: No targets found.
Nov 06 22:42:24 user nova-compute[75000]: iSNS:
Nov 06 22:42:24 user nova-compute[75000]: No targets found.
Nov 06 22:42:24 user nova-compute[75000]: STATIC:
Nov 06 22:42:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10
Nov 06 22:42:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:42:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:42:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:42:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2
Nov 06 22:42:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:24 user nova-compute[75000]: FIRMWARE:
Nov 06 22:42:24 user nova-compute[75000]: No targets found.
Nov 06 22:42:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:42:24 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:42:24 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0de9a8-552a-4f3b-8b1e-0b5531182d03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[387f549f-aaa5-4f42-bc71-77e2005fe0ba]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:42:24 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:42:24 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:42:24 user nova-compute[75000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 (non-flash)
Nov 06 22:42:24 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:42:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:42:24 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:42:24 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:42:24 user nova-compute[75000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 (non-flash)
Nov 06 22:42:24 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:42:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7a093d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10'): ({'sde'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Removing single pathed devices sde {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a527b7ee-ff2b-4ecc-bb81-b6e5c61f230c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b009c5e-ea88-443b-945c-3976911db10f]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Flushing IO for device /dev/sde {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8225e8c3-ed0d-4c94-aae5-65906c096195]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:42:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69856203-c94d-4242-a7f8-12ffbd2d45f4]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0731bb-eb1e-43c1-9d42-73dc0c838cf4]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:25 user nova-compute[75000]: INFO nova.compute.manager [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Detaching volume 908efb7e-e146-4c70-96fa-4816637579a2
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b174672e-4eb9-44da-94cd-a985205dc539]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10, portal: 172.16.0.220,3260]
Nov 06 22:42:25 user nova-compute[75000]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10, portal: 172.16.0.220,3260] successful.
Nov 06 22:42:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:25 user nova-compute[75000]: INFO nova.virt.block_device [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Attempting to driver detach volume 908efb7e-e146-4c70-96fa-4816637579a2 from mountpoint /dev/vdb
Nov 06 22:42:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Attempting to detach device vdb from instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:42:25 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:42:25 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:42:25 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:42:25 user nova-compute[75000]:   <serial>908efb7e-e146-4c70-96fa-4816637579a2</serial>
Nov 06 22:42:25 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:42:25 user nova-compute[75000]: </disk>
Nov 06 22:42:25 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ada9f6a-9d1a-4aaa-bcdc-9af9d02dce10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Successfully detached device vdb from instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd from the persistent domain config.
Nov 06 22:42:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:42:25 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:42:25 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:42:25 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:42:25 user nova-compute[75000]:   <serial>908efb7e-e146-4c70-96fa-4816637579a2</serial>
Nov 06 22:42:25 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:42:25 user nova-compute[75000]: </disk>
Nov 06 22:42:25 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35c122c-eb68-4a93-8465-fac3889eadaf]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== disconnect_volume: return (402ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:42:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:42:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a2979e6f-39ad-4f90-904e-71f22967900d tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.259s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:27 user nova-compute[75000]: INFO nova.compute.manager [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Terminating instance
Nov 06 22:42:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:27 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Instance destroyed successfully.
Nov 06 22:42:27 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'resources' on Instance uuid b2c6375a-d847-45e8-a0e8-42b37eb0af7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-627868483',display_name='tempest-ServerRescueNegativeTestJSON-server-627868483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-627868483',id=5,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:27:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-5y4ic5jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:27:36Z,user_data=None,user_id='f50e6a64752e488b9699a8bdda46253c',uuid=b2c6375a-d847-45e8-a0e8-42b37eb0af7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "address": "fa:16:3e:54:00:b6", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap031b54fe-fc", "ovs_interfaceid": "031b54fe-fcfa-4d89-92fc-83adb16b5458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=031b54fe-fcfa-4d89-92fc-83adb16b5458,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031b54fe-fc') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG os_vif [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=031b54fe-fcfa-4d89-92fc-83adb16b5458,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031b54fe-fc') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap031b54fe-fc, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9150373-e3ef-48d6-9c1b-780cf6235a9d) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:42:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:42:28 user nova-compute[75000]: INFO os_vif [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=031b54fe-fcfa-4d89-92fc-83adb16b5458,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap031b54fe-fc')
Nov 06 22:42:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Deleting instance files /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f_del
Nov 06 22:42:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Deletion of /opt/stack/data/nova/instances/b2c6375a-d847-45e8-a0e8-42b37eb0af7f_del complete
Nov 06 22:42:28 user nova-compute[75000]: INFO nova.compute.manager [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 06 22:42:28 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:28 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Took 0.42 seconds to deallocate network for instance.
Nov 06 22:42:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e91267b-4df7-4a0d-8977-e82d64dfbf17 req-06dccf8e-e7fc-457d-ba3d-b435af97c9db service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Received event network-vif-deleted-031b54fe-fcfa-4d89-92fc-83adb16b5458 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:28 user nova-compute[75000]: INFO nova.compute.manager [req-7e91267b-4df7-4a0d-8977-e82d64dfbf17 req-06dccf8e-e7fc-457d-ba3d-b435af97c9db service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Neutron deleted interface 031b54fe-fcfa-4d89-92fc-83adb16b5458; detaching it from the instance and deleting it from the info cache
Nov 06 22:42:28 user nova-compute[75000]: DEBUG nova.network.neutron [req-7e91267b-4df7-4a0d-8977-e82d64dfbf17 req-06dccf8e-e7fc-457d-ba3d-b435af97c9db service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-7e91267b-4df7-4a0d-8977-e82d64dfbf17 req-06dccf8e-e7fc-457d-ba3d-b435af97c9db service nova] [instance: b2c6375a-d847-45e8-a0e8-42b37eb0af7f] Detach interface failed, port_id=031b54fe-fcfa-4d89-92fc-83adb16b5458, reason: Instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:42:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:29 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Deleted allocations for instance b2c6375a-d847-45e8-a0e8-42b37eb0af7f
Nov 06 22:42:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7328ddb-9cf8-4f7b-8689-f3a67dc2fd96 tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "b2c6375a-d847-45e8-a0e8-42b37eb0af7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.929s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:42:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:38 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:42:38 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7473MB free_disk=24.942134857177734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Applying migration context for instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 as it has an incoming, in-progress migration c9f4aeed-1861-426f-95b6-bf092c779e85. Migration status is finished {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 22:42:38 user nova-compute[75000]: INFO nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating resource usage from migration c9f4aeed-1861-426f-95b6-bf092c779e85
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f48bca3c-8e15-4729-a01c-9741c4794a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 16b393b8-83f7-4a36-9de2-f8c230c94be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b06e5a39-e167-40c6-80a8-d70ca8e0ec7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Migration c9f4aeed-1861-426f-95b6-bf092c779e85 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f31ab346-0c23-4086-9c16-3322dc972c5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:42:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:42:39 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:42:39 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:42:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:42:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updating instance_info_cache with network_info: [{"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-f48bca3c-8e15-4729-a01c-9741c4794a2f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:42:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:42:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:42:45 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd is timed out.
Nov 06 22:42:45 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Successfully detached device vdb from instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd from the live domain config.
Nov 06 22:42:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQuTzEph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:42:45 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f78852-2db5-4d01-86f3-e7883d14ed41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:42:45 user nova-compute[75000]: No targets found.
Nov 06 22:42:45 user nova-compute[75000]: iSNS:
Nov 06 22:42:45 user nova-compute[75000]: No targets found.
Nov 06 22:42:45 user nova-compute[75000]: STATIC:
Nov 06 22:42:45 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:42:45 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:45 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:45 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:42:45 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:45 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:45 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:42:45 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:45 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:45 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2
Nov 06 22:42:45 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:45 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:45 user nova-compute[75000]: FIRMWARE:
Nov 06 22:42:45 user nova-compute[75000]: No targets found.
Nov 06 22:42:45 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:42:45 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:42:45 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[669e711a-9720-4423-94f1-367b99b28124]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d296391-8a64-4c17-b075-5696db10786a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:42:45 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:42:45 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:42:45 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:42:45 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:42:45 user nova-compute[75000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 (non-flash)
Nov 06 22:42:45 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:42:45 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:42:45 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79fc168700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c31c5-cc0f-41b2-bd7d-d1119553d6a1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[332d1add-5326-4142-806d-c201557d7a3c]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7842b2a9-168a-4bd3-b69a-639a8adc850d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[122eaa10-ee7e-43f8-af81-2d34ef483a0f]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a53060-1308-454d-a441-c8525d1b5565]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eca7ea-1e10-432a-abe0-47e28b7e7f45]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2, portal: 172.16.0.220,3260]
Nov 06 22:42:46 user nova-compute[75000]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2, portal: 172.16.0.220,3260] successful.
Nov 06 22:42:46 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50edb1a-71e2-4c21-acf9-8cf36652e9dc]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] <== disconnect_volume: return (348ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-ff593258-7c55-4a50-8470-663c5909f4a7 req-381157ee-ce28-4973-aa91-193878bf7fb9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-changed-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-ff593258-7c55-4a50-8470-663c5909f4a7 req-381157ee-ce28-4973-aa91-193878bf7fb9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Refreshing instance network info cache due to event network-changed-035045a6-0a9c-4787-8776-876c1cb58343. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ff593258-7c55-4a50-8470-663c5909f4a7 req-381157ee-ce28-4973-aa91-193878bf7fb9 service nova] Acquiring lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ff593258-7c55-4a50-8470-663c5909f4a7 req-381157ee-ce28-4973-aa91-193878bf7fb9 service nova] Acquired lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:42:46 user nova-compute[75000]: DEBUG nova.network.neutron [req-ff593258-7c55-4a50-8470-663c5909f4a7 req-381157ee-ce28-4973-aa91-193878bf7fb9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Refreshing network info cache for port 035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG nova.network.neutron [req-ff593258-7c55-4a50-8470-663c5909f4a7 req-381157ee-ce28-4973-aa91-193878bf7fb9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updated VIF entry in instance network info cache for port 035045a6-0a9c-4787-8776-876c1cb58343. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG nova.network.neutron [req-ff593258-7c55-4a50-8470-663c5909f4a7 req-381157ee-ce28-4973-aa91-193878bf7fb9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updating instance_info_cache with network_info: [{"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ff593258-7c55-4a50-8470-663c5909f4a7 req-381157ee-ce28-4973-aa91-193878bf7fb9 service nova] Releasing lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'flavor' on Instance uuid fd2235fd-3b64-4ff2-8350-aa3a9b092ecd {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a5508fb9-edbd-41c2-8159-c1cb5cfdf6ad tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.355s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.196s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:47 user nova-compute[75000]: INFO nova.compute.manager [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Terminating instance
Nov 06 22:42:47 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Instance destroyed successfully.
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.objects.instance [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'resources' on Instance uuid fd2235fd-3b64-4ff2-8350-aa3a9b092ecd {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-916804623',display_name='tempest-VolumesSnapshotTestJSON-instance-916804623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-916804623',id=30,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2W1yzz96c0Zcv2mfg3KJTAsEI8lhsEv4wVfBZ621roHpP5WVj1ph6QkyWmrGNp0IfYN/lQMuC5kOCD5kWPwOXUB9IVdMCV78YHYj4QgyguA1r+MvJnOd8C4D2xNrFHWA==',key_name='tempest-keypair-88670871',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:38:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c00b052f634d689bfa3e28ffce3d95',ramdisk_id='',reservation_id='r-orzimbxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-549753594',owner_user_name='tempest-VolumesSnapshotTestJSON-549753594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d288b4ec7d714054aefff906d8070a5d',uuid=fd2235fd-3b64-4ff2-8350-aa3a9b092ecd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converting VIF {"id": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "address": "fa:16:3e:47:ec:20", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b301c5-8c", "ovs_interfaceid": "65b301c5-8c5d-4f69-9664-ec9fa0df1f58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:ec:20,bridge_name='br-int',has_traffic_filtering=True,id=65b301c5-8c5d-4f69-9664-ec9fa0df1f58,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b301c5-8c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_vif [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:ec:20,bridge_name='br-int',has_traffic_filtering=True,id=65b301c5-8c5d-4f69-9664-ec9fa0df1f58,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b301c5-8c') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65b301c5-8c, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b037ed7-30b6-4390-9c1b-e8e00decb881) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:48 user nova-compute[75000]: INFO os_vif [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:ec:20,bridge_name='br-int',has_traffic_filtering=True,id=65b301c5-8c5d-4f69-9664-ec9fa0df1f58,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b301c5-8c')
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQuTzEph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:42:48 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[64df72e3-efa5-458a-b90f-fd745b0c6585]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:42:48 user nova-compute[75000]: No targets found.
Nov 06 22:42:48 user nova-compute[75000]: iSNS:
Nov 06 22:42:48 user nova-compute[75000]: No targets found.
Nov 06 22:42:48 user nova-compute[75000]: STATIC:
Nov 06 22:42:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:42:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:42:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:48 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:42:48 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:42:48 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:42:48 user nova-compute[75000]: FIRMWARE:
Nov 06 22:42:48 user nova-compute[75000]: No targets found.
Nov 06 22:42:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:42:48 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:42:48 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908efb7e-e146-4c70-96fa-4816637579a2', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e7c167-237d-42e9-85bd-a879b1265ad2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[694986d0-655e-47d8-b9b5-3f7b4159253a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:42:48 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:42:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:42:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:42:48 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:42:48 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:42:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc14acb0>, {}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Disconnecting from: [] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] <== disconnect_volume: return (88ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:42:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Deleting instance files /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd_del
Nov 06 22:42:48 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Deletion of /opt/stack/data/nova/instances/fd2235fd-3b64-4ff2-8350-aa3a9b092ecd_del complete
Nov 06 22:42:48 user nova-compute[75000]: INFO nova.compute.manager [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received event network-vif-unplugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] No waiting events found dispatching network-vif-unplugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received event network-vif-unplugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received event network-vif-plugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] Acquiring lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] No waiting events found dispatching network-vif-plugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:48 user nova-compute[75000]: WARNING nova.compute.manager [req-dede0b46-2f85-43d1-ad48-d3a33cb78932 req-7bfe8c85-3be0-4fba-b7ee-c50ba90091c9 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received unexpected event network-vif-plugged-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 for instance with vm_state active and task_state deleting.
Nov 06 22:42:49 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-75648bf0-c02d-460b-bf91-ad62e73e1575 req-1bb434ba-aef5-4c0d-8568-d3e13c2c09c1 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Received event network-vif-deleted-65b301c5-8c5d-4f69-9664-ec9fa0df1f58 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:49 user nova-compute[75000]: INFO nova.compute.manager [req-75648bf0-c02d-460b-bf91-ad62e73e1575 req-1bb434ba-aef5-4c0d-8568-d3e13c2c09c1 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Neutron deleted interface 65b301c5-8c5d-4f69-9664-ec9fa0df1f58; detaching it from the instance and deleting it from the info cache
Nov 06 22:42:49 user nova-compute[75000]: DEBUG nova.network.neutron [req-75648bf0-c02d-460b-bf91-ad62e73e1575 req-1bb434ba-aef5-4c0d-8568-d3e13c2c09c1 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:49 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Took 1.28 seconds to deallocate network for instance.
Nov 06 22:42:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-75648bf0-c02d-460b-bf91-ad62e73e1575 req-1bb434ba-aef5-4c0d-8568-d3e13c2c09c1 service nova] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Detach interface failed, port_id=65b301c5-8c5d-4f69-9664-ec9fa0df1f58, reason: Instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:42:49 user nova-compute[75000]: WARNING nova.volume.cinder [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Attachment 1bd75d8f-fc67-471e-80c1-ab6c2b6c2fab does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1bd75d8f-fc67-471e-80c1-ab6c2b6c2fab. (HTTP 404) (Request-ID: req-d3f80fee-ea8c-4485-b5ae-6744e11c64db)
Nov 06 22:42:49 user nova-compute[75000]: INFO nova.compute.manager [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: fd2235fd-3b64-4ff2-8350-aa3a9b092ecd] Took 0.04 seconds to detach 1 volumes for instance.
Nov 06 22:42:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:50 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:42:50 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:42:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:50 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Deleted allocations for instance fd2235fd-3b64-4ff2-8350-aa3a9b092ecd
Nov 06 22:42:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d2bf5ef5-40c7-4582-a792-46d7c06caec2 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "fd2235fd-3b64-4ff2-8350-aa3a9b092ecd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.044s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:42:51 user nova-compute[75000]: INFO nova.compute.claims [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Claim successful on node user
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:42:51 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.policy [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33f333b132a1474d983798ab0642b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf4f6360f6c486ab24087a20da8b6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:42:51 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Creating image(s)
Nov 06 22:42:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "/opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "/opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "/opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk 1073741824" returned: 0 in 0.058s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Successfully created port: a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Cannot resize image /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Ensure instance console log exists: /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:53 user nova-compute[75000]: INFO nova.compute.manager [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Shelving
Nov 06 22:42:53 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Successfully updated port: a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "refresh_cache-72e24734-35e3-4e5c-9f8a-85d14397387d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquired lock "refresh_cache-72e24734-35e3-4e5c-9f8a-85d14397387d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-22016679-cb21-4ee9-98bf-385505686e27 req-b8ff792d-c734-4368-8995-ce21b3e101aa service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received event network-changed-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-22016679-cb21-4ee9-98bf-385505686e27 req-b8ff792d-c734-4368-8995-ce21b3e101aa service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Refreshing instance network info cache due to event network-changed-a2cfad28-beca-4749-8335-a2a69ddcc677. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-22016679-cb21-4ee9-98bf-385505686e27 req-b8ff792d-c734-4368-8995-ce21b3e101aa service nova] Acquiring lock "refresh_cache-72e24734-35e3-4e5c-9f8a-85d14397387d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Updating instance_info_cache with network_info: [{"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Releasing lock "refresh_cache-72e24734-35e3-4e5c-9f8a-85d14397387d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Instance network_info: |[{"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-22016679-cb21-4ee9-98bf-385505686e27 req-b8ff792d-c734-4368-8995-ce21b3e101aa service nova] Acquired lock "refresh_cache-72e24734-35e3-4e5c-9f8a-85d14397387d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-22016679-cb21-4ee9-98bf-385505686e27 req-b8ff792d-c734-4368-8995-ce21b3e101aa service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Refreshing network info cache for port a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Start _get_guest_xml network_info=[{"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:42:54 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:42:54 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-664303252',display_name='tempest-AttachVolumeNegativeTest-server-664303252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-664303252',id=34,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGogN6tIEd6isNIYw39+qKM2NiVbZVLAURGMG1MvYZ/0ScSbRjDMm84+7qND/DszYyCg45h0otT/gOQcfGL3pEcKVGXPgPOqp3HkTaKSJCURkL6K+4IOOCrGH0XZ3/tA7g==',key_name='tempest-keypair-55703073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-4puyx7jg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=72e24734-35e3-4e5c-9f8a-85d14397387d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:4a:93,bridge_name='br-int',has_traffic_filtering=True,id=a2cfad28-beca-4749-8335-a2a69ddcc677,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2cfad28-be') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'pci_devices' on Instance uuid 72e24734-35e3-4e5c-9f8a-85d14397387d {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:42:54 user nova-compute[75000]:   <uuid>72e24734-35e3-4e5c-9f8a-85d14397387d</uuid>
Nov 06 22:42:54 user nova-compute[75000]:   <name>instance-00000022</name>
Nov 06 22:42:54 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:42:54 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:42:54 user nova-compute[75000]:   <metadata>
Nov 06 22:42:54 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:42:54 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:42:54 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeNegativeTest-server-664303252</nova:name>
Nov 06 22:42:54 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:42:54</nova:creationTime>
Nov 06 22:42:54 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:42:54 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:42:54 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:42:54 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:42:54 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:42:54 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:42:54 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:42:54 user nova-compute[75000]:       <nova:owner>
Nov 06 22:42:54 user nova-compute[75000]:         <nova:user uuid="33f333b132a1474d983798ab0642b053">tempest-AttachVolumeNegativeTest-90304964-project-member</nova:user>
Nov 06 22:42:54 user nova-compute[75000]:         <nova:project uuid="0cf4f6360f6c486ab24087a20da8b6cb">tempest-AttachVolumeNegativeTest-90304964</nova:project>
Nov 06 22:42:54 user nova-compute[75000]:       </nova:owner>
Nov 06 22:42:54 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:42:54 user nova-compute[75000]:       <nova:ports>
Nov 06 22:42:54 user nova-compute[75000]:         <nova:port uuid="a2cfad28-beca-4749-8335-a2a69ddcc677">
Nov 06 22:42:54 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 22:42:54 user nova-compute[75000]:         </nova:port>
Nov 06 22:42:54 user nova-compute[75000]:       </nova:ports>
Nov 06 22:42:54 user nova-compute[75000]:     </nova:instance>
Nov 06 22:42:54 user nova-compute[75000]:   </metadata>
Nov 06 22:42:54 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:42:54 user nova-compute[75000]:     <system>
Nov 06 22:42:54 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:42:54 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:42:54 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:42:54 user nova-compute[75000]:       <entry name="serial">72e24734-35e3-4e5c-9f8a-85d14397387d</entry>
Nov 06 22:42:54 user nova-compute[75000]:       <entry name="uuid">72e24734-35e3-4e5c-9f8a-85d14397387d</entry>
Nov 06 22:42:54 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:42:54 user nova-compute[75000]:     </system>
Nov 06 22:42:54 user nova-compute[75000]:   </sysinfo>
Nov 06 22:42:54 user nova-compute[75000]:   <os>
Nov 06 22:42:54 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:42:54 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:42:54 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:42:54 user nova-compute[75000]:   </os>
Nov 06 22:42:54 user nova-compute[75000]:   <features>
Nov 06 22:42:54 user nova-compute[75000]:     <acpi/>
Nov 06 22:42:54 user nova-compute[75000]:     <apic/>
Nov 06 22:42:54 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:42:54 user nova-compute[75000]:   </features>
Nov 06 22:42:54 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:42:54 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:42:54 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:42:54 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:42:54 user nova-compute[75000]:   </clock>
Nov 06 22:42:54 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:42:54 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:42:54 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:42:54 user nova-compute[75000]:   </cpu>
Nov 06 22:42:54 user nova-compute[75000]:   <devices>
Nov 06 22:42:54 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:42:54 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:42:54 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk"/>
Nov 06 22:42:54 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:42:54 user nova-compute[75000]:     </disk>
Nov 06 22:42:54 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:42:54 user nova-compute[75000]:       <mac address="fa:16:3e:21:4a:93"/>
Nov 06 22:42:54 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:42:54 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:42:54 user nova-compute[75000]:       <target dev="tapa2cfad28-be"/>
Nov 06 22:42:54 user nova-compute[75000]:     </interface>
Nov 06 22:42:54 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:42:54 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/console.log" append="off"/>
Nov 06 22:42:54 user nova-compute[75000]:     </serial>
Nov 06 22:42:54 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:42:54 user nova-compute[75000]:     <video>
Nov 06 22:42:54 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:42:54 user nova-compute[75000]:     </video>
Nov 06 22:42:54 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:42:54 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:42:54 user nova-compute[75000]:     </rng>
Nov 06 22:42:54 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:42:54 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:42:54 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:42:54 user nova-compute[75000]:     </memballoon>
Nov 06 22:42:54 user nova-compute[75000]:   </devices>
Nov 06 22:42:54 user nova-compute[75000]: </domain>
Nov 06 22:42:54 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-664303252',display_name='tempest-AttachVolumeNegativeTest-server-664303252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-664303252',id=34,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGogN6tIEd6isNIYw39+qKM2NiVbZVLAURGMG1MvYZ/0ScSbRjDMm84+7qND/DszYyCg45h0otT/gOQcfGL3pEcKVGXPgPOqp3HkTaKSJCURkL6K+4IOOCrGH0XZ3/tA7g==',key_name='tempest-keypair-55703073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-4puyx7jg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=72e24734-35e3-4e5c-9f8a-85d14397387d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:4a:93,bridge_name='br-int',has_traffic_filtering=True,id=a2cfad28-beca-4749-8335-a2a69ddcc677,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2cfad28-be') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG os_vif [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:4a:93,bridge_name='br-int',has_traffic_filtering=True,id=a2cfad28-beca-4749-8335-a2a69ddcc677,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2cfad28-be') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfe9088f-5b3f-55d9-93e4-f97bf4cc7c6f', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2cfad28-be, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2cfad28-be, col_values=(('qos', UUID('f769d296-ce55-4fb2-a039-0c5f3b5853df')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2cfad28-be, col_values=(('external_ids', {'iface-id': 'a2cfad28-beca-4749-8335-a2a69ddcc677', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:4a:93', 'vm-uuid': '72e24734-35e3-4e5c-9f8a-85d14397387d'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: INFO os_vif [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:4a:93,bridge_name='br-int',has_traffic_filtering=True,id=a2cfad28-beca-4749-8335-a2a69ddcc677,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2cfad28-be')
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No VIF found with MAC fa:16:3e:21:4a:93, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-22016679-cb21-4ee9-98bf-385505686e27 req-b8ff792d-c734-4368-8995-ce21b3e101aa service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Updated VIF entry in instance network info cache for port a2cfad28-beca-4749-8335-a2a69ddcc677. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-22016679-cb21-4ee9-98bf-385505686e27 req-b8ff792d-c734-4368-8995-ce21b3e101aa service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Updating instance_info_cache with network_info: [{"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-22016679-cb21-4ee9-98bf-385505686e27 req-b8ff792d-c734-4368-8995-ce21b3e101aa service nova] Releasing lock "refresh_cache-72e24734-35e3-4e5c-9f8a-85d14397387d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:42:54 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance destroyed successfully.
Nov 06 22:42:54 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Beginning cold snapshot process
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk /opt/stack/data/nova/instances/snapshots/tmpfp9f66vd/d880cef564bd43198526bd4d5962f731 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:42:55 user nova-compute[75000]: INFO nova.compute.claims [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Claim successful on node user
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:55 user nova-compute[75000]: WARNING nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:55 user nova-compute[75000]: WARNING nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:55 user nova-compute[75000]: WARNING nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:55 user nova-compute[75000]: WARNING nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:55 user nova-compute[75000]: WARNING nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:55 user nova-compute[75000]: WARNING nova.compute.manager [req-349a90a3-0b7d-4076-a920-1c4899aa09f7 req-1833e078-4084-4a39-a7b9-37973b622f19 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 06 22:42:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk /opt/stack/data/nova/instances/snapshots/tmpfp9f66vd/d880cef564bd43198526bd4d5962f731" returned: 0 in 0.914s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:42:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Snapshot extracted, beginning image upload
Nov 06 22:42:56 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG nova.network.neutron [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:42:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:42:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:42:56 user nova-compute[75000]: INFO nova.virt.block_device [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Booting with volume snapshot 3431ec72-91f6-4c91-9840-0ac9961a8874 at /dev/vda
Nov 06 22:42:56 user nova-compute[75000]: DEBUG nova.policy [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d4aa96179fd4121ba224f47c01d9364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828fc01bb744496f83bd0f5d90e6924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Successfully created port: d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received event network-vif-plugged-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] No waiting events found dispatching network-vif-plugged-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:57 user nova-compute[75000]: WARNING nova.compute.manager [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received unexpected event network-vif-plugged-a2cfad28-beca-4749-8335-a2a69ddcc677 for instance with vm_state building and task_state spawning.
Nov 06 22:42:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received event network-vif-plugged-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:57 user nova-compute[75000]: DEBUG nova.compute.manager [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] No waiting events found dispatching network-vif-plugged-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:42:57 user nova-compute[75000]: WARNING nova.compute.manager [req-c2315e8d-5d52-4982-a16f-56f9b9534593 req-59949c0d-099b-4631-8454-d6ac3a2bf116 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received unexpected event network-vif-plugged-a2cfad28-beca-4749-8335-a2a69ddcc677 for instance with vm_state building and task_state spawning.
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Successfully updated port: d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "refresh_cache-c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquired lock "refresh_cache-c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:42:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Instance spawned successfully.
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Updating instance_info_cache with network_info: [{"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Releasing lock "refresh_cache-c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Instance network_info: |[{"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:42:58 user nova-compute[75000]: INFO nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 06 22:42:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:42:58 user nova-compute[75000]: INFO nova.compute.manager [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Took 7.46 seconds to build instance.
Nov 06 22:42:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a1e797b-d9e3-4bac-879d-3e49c9eebc3f tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.672s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:42:59 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Snapshot image upload complete
Nov 06 22:42:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:42:59 user nova-compute[75000]: INFO nova.compute.manager [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Shelve offloading
Nov 06 22:42:59 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance destroyed successfully.
Nov 06 22:42:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquired lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG nova.network.neutron [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG nova.network.neutron [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updating instance_info_cache with network_info: [{"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Releasing lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-257f42cc-0334-41e7-8219-d059c2510fdc req-274a7ecf-b0fd-416e-8a10-d909b97abb31 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received event network-changed-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-257f42cc-0334-41e7-8219-d059c2510fdc req-274a7ecf-b0fd-416e-8a10-d909b97abb31 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Refreshing instance network info cache due to event network-changed-d003f172-c53f-475d-95c8-32c8e48aa486. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-257f42cc-0334-41e7-8219-d059c2510fdc req-274a7ecf-b0fd-416e-8a10-d909b97abb31 service nova] Acquiring lock "refresh_cache-c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-257f42cc-0334-41e7-8219-d059c2510fdc req-274a7ecf-b0fd-416e-8a10-d909b97abb31 service nova] Acquired lock "refresh_cache-c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:42:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-257f42cc-0334-41e7-8219-d059c2510fdc req-274a7ecf-b0fd-416e-8a10-d909b97abb31 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Refreshing network info cache for port d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:43:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance destroyed successfully.
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.objects.instance [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'resources' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746831654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746831654',id=33,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPxX3LQJMq6tbA/hp/lkqOxna0KLgPcQgngOnf//5bF/+o23OPHaIMGxPh3RSWIaWtgEnV/1dtxkMDXBS8dkft0f4nQOiXD+EFnxP/eLWaTSQIwl2JuGfmafYMiyOjUOg==',key_name='tempest-keypair-1457495529',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-06levmq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member',shelved_at='2023-11-06T22:42:59.029053',shelved_host='user',shelved_image_id='8a2cf4d7-17cb-4498-b8eb-555b273bec10'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=f31ab346-0c23-4086-9c16-3322dc972c5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG os_vif [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap035045a6-0a, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c302b3b2-56fd-401c-af44-dd5db4667bb3) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:00 user nova-compute[75000]: INFO os_vif [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a')
Nov 06 22:43:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Deleting instance files /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f_del
Nov 06 22:43:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Deletion of /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f_del complete
Nov 06 22:43:00 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Deleted allocations for instance f31ab346-0c23-4086-9c16-3322dc972c5f
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.network.neutron [req-257f42cc-0334-41e7-8219-d059c2510fdc req-274a7ecf-b0fd-416e-8a10-d909b97abb31 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Updated VIF entry in instance network info cache for port d003f172-c53f-475d-95c8-32c8e48aa486. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.network.neutron [req-257f42cc-0334-41e7-8219-d059c2510fdc req-274a7ecf-b0fd-416e-8a10-d909b97abb31 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Updating instance_info_cache with network_info: [{"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-257f42cc-0334-41e7-8219-d059c2510fdc req-274a7ecf-b0fd-416e-8a10-d909b97abb31 service nova] Releasing lock "refresh_cache-c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.objects.instance [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'numa_topology' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.objects.base [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<f31ab346-0c23-4086-9c16-3322dc972c5f> lazy-loaded attributes: resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-53aad4fd-ac31-4bd7-ba0e-ea4ed37a863a tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.250s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG nova.objects.instance [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Going to confirm migration 2 {{(pid=75000) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:01 user nova-compute[75000]: INFO nova.compute.manager [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attaching volume b7d6ceca-a6ef-4959-a9bf-205184fc31b7 to /dev/vdb
Nov 06 22:43:01 user nova-compute[75000]: DEBUG os_brick.utils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce1a9dd-cfd7-434c-8dc2-2a1341eb8a4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ece697-fa9e-4c8b-b86c-222b769076bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c8c810-5b8b-4763-ad22-012b961d3ee7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fed230-8eff-47c6-9c52-9d19fb6e2261]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:43:01 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:43:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9168043e-933f-4418-8a0b-4515ac838151]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG os_brick.utils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:43:01 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating existing volume attachment record: 97357863-fe0f-4770-bdc4-c80ca750f8d3 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquired lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'info_cache' on Instance uuid 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG os_brick.utils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d29205-2bcf-404b-9d48-f188f16a50b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[636b201e-5368-4aa1-a430-f9ebe25d93d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8583882-3610-4ed7-a676-871f03f309d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[462c6086-acff-49c5-8383-97b5562ae3b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:43:02 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73a3f97-f8f5-4f22-b0b4-66c3b462010a]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG os_brick.utils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Updating existing volume attachment record: 36b34898-f22a-45d3-8097-aafe04cb5909 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating instance_info_cache with network_info: [{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Releasing lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'migration_context' on Instance uuid 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG nova.objects.base [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Object Instance<2ea4dcf9-775b-4f7c-8cac-0a325a74dc65> lazy-loaded attributes: info_cache,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:03 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:43:03 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:43:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.508s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:03 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Deleted allocation for migration c9f4aeed-1861-426f-95b6-bf092c779e85
Nov 06 22:43:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8333a441-ef41-4a78-9ad8-6ef45ab358b8 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.667s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:43:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:43:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:43:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:43:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:17 user nova-compute[75000]: INFO nova.compute.manager [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Terminating instance
Nov 06 22:43:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:17 user nova-compute[75000]: INFO nova.compute.manager [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Terminating instance
Nov 06 22:43:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed8fe7a0-0761-4300-aded-4f7622556667 req-bfc19736-81a9-4138-918b-5e3978f74ef6 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed8fe7a0-0761-4300-aded-4f7622556667 req-bfc19736-81a9-4138-918b-5e3978f74ef6 service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed8fe7a0-0761-4300-aded-4f7622556667 req-bfc19736-81a9-4138-918b-5e3978f74ef6 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed8fe7a0-0761-4300-aded-4f7622556667 req-bfc19736-81a9-4138-918b-5e3978f74ef6 service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed8fe7a0-0761-4300-aded-4f7622556667 req-bfc19736-81a9-4138-918b-5e3978f74ef6 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed8fe7a0-0761-4300-aded-4f7622556667 req-bfc19736-81a9-4138-918b-5e3978f74ef6 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Instance destroyed successfully.
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'resources' on Instance uuid 16b393b8-83f7-4a36-9de2-f8c230c94be5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Instance destroyed successfully.
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.objects.instance [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lazy-loading 'resources' on Instance uuid f48bca3c-8e15-4729-a01c-9741c4794a2f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1791801885',display_name='tempest-ServerRescueNegativeTestJSON-server-1791801885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1791801885',id=4,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:30:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b4b9d5ecee54acb8ca3534a38500b4f',ramdisk_id='',reservation_id='r-3wtyelfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-259573853',owner_user_name='tempest-ServerRescueNegativeTestJSON-259573853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:32:26Z,user_data=None,user_id='f50e6a64752e488b9699a8bdda46253c',uuid=f48bca3c-8e15-4729-a01c-9741c4794a2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converting VIF {"id": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "address": "fa:16:3e:e4:ec:d9", "network": {"id": "e511206c-2761-463e-9271-98367f1973da", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1467481583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b4b9d5ecee54acb8ca3534a38500b4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf671c9ae-e9", "ovs_interfaceid": "f671c9ae-e9f9-4276-8291-76aaf4510fa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=f671c9ae-e9f9-4276-8291-76aaf4510fa8,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf671c9ae-e9') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG os_vif [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=f671c9ae-e9f9-4276-8291-76aaf4510fa8,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf671c9ae-e9') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:33:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1953138957',display_name='tempest-AttachVolumeTestJSON-server-1953138957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1953138957',id=21,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKYUG+wX+Oy+5ZoCKABFPtVTS7CC7ezeu/QxRZrCFggdt3WxIBlw/f9Sjy6ccYGHltY5PMTkclfZi01PiCR7pnVT8WAyKEH2jdwmIpQmqFPlb4e6rSMVTU80G2v7DaTuQ==',key_name='tempest-keypair-458501348',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:33:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-r3alv0me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=16b393b8-83f7-4a36-9de2-f8c230c94be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "78f02e5b-8e34-4d73-907b-c49095cc8147", "address": "fa:16:3e:a0:b0:4e", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f02e5b-8e", "ovs_interfaceid": "78f02e5b-8e34-4d73-907b-c49095cc8147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG os_vif [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78f02e5b-8e, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf671c9ae-e9, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d322658-99ca-44a3-ae5c-5e4da7044928) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf64f136-a7aa-47e0-aec3-9fec6cc6d13a) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: INFO os_vif [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:b0:4e,bridge_name='br-int',has_traffic_filtering=True,id=78f02e5b-8e34-4d73-907b-c49095cc8147,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f02e5b-8e')
Nov 06 22:43:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Deleting instance files /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5_del
Nov 06 22:43:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Deletion of /opt/stack/data/nova/instances/16b393b8-83f7-4a36-9de2-f8c230c94be5_del complete
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: INFO os_vif [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=f671c9ae-e9f9-4276-8291-76aaf4510fa8,network=Network(e511206c-2761-463e-9271-98367f1973da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf671c9ae-e9')
Nov 06 22:43:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Deleting instance files /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f_del
Nov 06 22:43:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Deletion of /opt/stack/data/nova/instances/f48bca3c-8e15-4729-a01c-9741c4794a2f_del complete
Nov 06 22:43:18 user nova-compute[75000]: INFO nova.compute.manager [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 06 22:43:18 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:43:18 user nova-compute[75000]: INFO nova.compute.manager [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 06 22:43:18 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:43:19 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Took 0.64 seconds to deallocate network for instance.
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-a57cd0b8-648e-4c6a-b006-725af0fad3f3 req-ccc41999-effc-4329-bc0b-12801b8e12b2 service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-deleted-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:19 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Deleted allocations for instance f48bca3c-8e15-4729-a01c-9741c4794a2f
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:19 user nova-compute[75000]: WARNING nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state active and task_state deleting.
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-unplugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-unplugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:19 user nova-compute[75000]: WARNING nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-unplugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state deleted and task_state None.
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Acquiring lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] No waiting events found dispatching network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:19 user nova-compute[75000]: WARNING nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: f48bca3c-8e15-4729-a01c-9741c4794a2f] Received unexpected event network-vif-plugged-f671c9ae-e9f9-4276-8291-76aaf4510fa8 for instance with vm_state deleted and task_state None.
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:19 user nova-compute[75000]: WARNING nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state active and task_state deleting.
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:19 user nova-compute[75000]: WARNING nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state active and task_state deleting.
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-unplugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Acquiring lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] No waiting events found dispatching network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:19 user nova-compute[75000]: WARNING nova.compute.manager [req-2c6dbac0-f5db-4b20-92c7-68411f7f792f req-1b6e029d-cce6-4f00-ac1d-3741c12af35a service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received unexpected event network-vif-plugged-78f02e5b-8e34-4d73-907b-c49095cc8147 for instance with vm_state active and task_state deleting.
Nov 06 22:43:19 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-6d306c3d-bf9f-4eda-a912-510bce7401ca tempest-ServerRescueNegativeTestJSON-259573853 tempest-ServerRescueNegativeTestJSON-259573853-project-member] Lock "f48bca3c-8e15-4729-a01c-9741c4794a2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:19 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Took 1.27 seconds to deallocate network for instance.
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-d293cfa0-6a00-44e9-a713-ebe633db3129 req-fb20dbec-a94b-4ebc-8dc0-b50e467fece1 service nova] [instance: 16b393b8-83f7-4a36-9de2-f8c230c94be5] Received event network-vif-deleted-78f02e5b-8e34-4d73-907b-c49095cc8147 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:20 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:43:20 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:43:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:20 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Deleted allocations for instance 16b393b8-83f7-4a36-9de2-f8c230c94be5
Nov 06 22:43:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e237ae7a-0dde-4771-828d-1c46d160c958 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "16b393b8-83f7-4a36-9de2-f8c230c94be5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:43:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Creating image(s)
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Ensure instance console log exists: /opt/stack/data/nova/instances/c1c40d17-3fb5-4b5d-9267-02cb7152ce3c/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Start _get_guest_xml network_info=[{"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTDFqxSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c1c40d17-3fb5-4b5d-9267-02cb7152ce3c', 'attached_at': '', 'detached_at': '', 'volume_id': '8422b892-b515-4efc-a2af-2989f0a672d3', 'serial': '8422b892-b515-4efc-a2af-2989f0a672d3'}, 'attachment_id': '36b34898-f22a-45d3-8097-aafe04cb5909', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:43:25 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:43:25 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTDFqxSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:43:25 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:43:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:43:25 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:43:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:43:25 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d484dbb-6ac3-46d7-9360-899ff03519bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:43:25 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe6c809-c99a-4e36-a497-01b27609abfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3] added
Nov 06 22:43:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57696a2-b081-48d3-9c18-93fa4da1b7b9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0820e2b6-899d-4969-8088-b2a5a29b448d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uTDFqxSf {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uTDFqxSf" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5422311d-5007-4bd5-81df-90b30f57e021]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uTDFqxSf'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03fb2af-9e82-4423-9968-700194946cc7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9147a85-604f-4abc-9926-8729718c91e8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8368927-8af2-4de0-b940-db59a55f6244]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3, portal: 172.16.0.220,3260]
Nov 06 22:43:26 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3, portal: 172.16.0.220,3260] successful.
Nov 06 22:43:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04cc41f-2ec3-4c48-8239-2d00ea49749e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f34410-4a50-4264-bf95-70a3730eb5d7]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60ef2ff-b4e2-48bf-91f4-532e018dc7d9]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTDFqxSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23862386430356433', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862386430356433', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1414744014',display_name='tempest-TestVolumeBootPattern-server-1414744014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1414744014',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-sa7z9djo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:42:57Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=c1c40d17-3fb5-4b5d-9267-02cb7152ce3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:7c,bridge_name='br-int',has_traffic_filtering=True,id=d003f172-c53f-475d-95c8-32c8e48aa486,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd003f172-c5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.objects.instance [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'pci_devices' on Instance uuid c1c40d17-3fb5-4b5d-9267-02cb7152ce3c {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:43:27 user nova-compute[75000]:   <uuid>c1c40d17-3fb5-4b5d-9267-02cb7152ce3c</uuid>
Nov 06 22:43:27 user nova-compute[75000]:   <name>instance-00000023</name>
Nov 06 22:43:27 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:43:27 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:43:27 user nova-compute[75000]:   <metadata>
Nov 06 22:43:27 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:43:27 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:43:27 user nova-compute[75000]:       <nova:name>tempest-TestVolumeBootPattern-server-1414744014</nova:name>
Nov 06 22:43:27 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:43:25</nova:creationTime>
Nov 06 22:43:27 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:43:27 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:43:27 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:43:27 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:43:27 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:43:27 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:43:27 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:43:27 user nova-compute[75000]:       <nova:owner>
Nov 06 22:43:27 user nova-compute[75000]:         <nova:user uuid="0d4aa96179fd4121ba224f47c01d9364">tempest-TestVolumeBootPattern-673062967-project-member</nova:user>
Nov 06 22:43:27 user nova-compute[75000]:         <nova:project uuid="828fc01bb744496f83bd0f5d90e6924f">tempest-TestVolumeBootPattern-673062967</nova:project>
Nov 06 22:43:27 user nova-compute[75000]:       </nova:owner>
Nov 06 22:43:27 user nova-compute[75000]:       <nova:ports>
Nov 06 22:43:27 user nova-compute[75000]:         <nova:port uuid="d003f172-c53f-475d-95c8-32c8e48aa486">
Nov 06 22:43:27 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 22:43:27 user nova-compute[75000]:         </nova:port>
Nov 06 22:43:27 user nova-compute[75000]:       </nova:ports>
Nov 06 22:43:27 user nova-compute[75000]:     </nova:instance>
Nov 06 22:43:27 user nova-compute[75000]:   </metadata>
Nov 06 22:43:27 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:43:27 user nova-compute[75000]:     <system>
Nov 06 22:43:27 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:43:27 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:43:27 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:43:27 user nova-compute[75000]:       <entry name="serial">c1c40d17-3fb5-4b5d-9267-02cb7152ce3c</entry>
Nov 06 22:43:27 user nova-compute[75000]:       <entry name="uuid">c1c40d17-3fb5-4b5d-9267-02cb7152ce3c</entry>
Nov 06 22:43:27 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:43:27 user nova-compute[75000]:     </system>
Nov 06 22:43:27 user nova-compute[75000]:   </sysinfo>
Nov 06 22:43:27 user nova-compute[75000]:   <os>
Nov 06 22:43:27 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:43:27 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:43:27 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:43:27 user nova-compute[75000]:   </os>
Nov 06 22:43:27 user nova-compute[75000]:   <features>
Nov 06 22:43:27 user nova-compute[75000]:     <acpi/>
Nov 06 22:43:27 user nova-compute[75000]:     <apic/>
Nov 06 22:43:27 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:43:27 user nova-compute[75000]:   </features>
Nov 06 22:43:27 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:43:27 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:43:27 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:43:27 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:43:27 user nova-compute[75000]:   </clock>
Nov 06 22:43:27 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:43:27 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:43:27 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:43:27 user nova-compute[75000]:   </cpu>
Nov 06 22:43:27 user nova-compute[75000]:   <devices>
Nov 06 22:43:27 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:43:27 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:43:27 user nova-compute[75000]:       <source dev="/dev/sdc"/>
Nov 06 22:43:27 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:43:27 user nova-compute[75000]:       <serial>8422b892-b515-4efc-a2af-2989f0a672d3</serial>
Nov 06 22:43:27 user nova-compute[75000]:     </disk>
Nov 06 22:43:27 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:43:27 user nova-compute[75000]:       <mac address="fa:16:3e:a8:ae:7c"/>
Nov 06 22:43:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:43:27 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:43:27 user nova-compute[75000]:       <target dev="tapd003f172-c5"/>
Nov 06 22:43:27 user nova-compute[75000]:     </interface>
Nov 06 22:43:27 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:43:27 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/c1c40d17-3fb5-4b5d-9267-02cb7152ce3c/console.log" append="off"/>
Nov 06 22:43:27 user nova-compute[75000]:     </serial>
Nov 06 22:43:27 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:43:27 user nova-compute[75000]:     <video>
Nov 06 22:43:27 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:43:27 user nova-compute[75000]:     </video>
Nov 06 22:43:27 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:43:27 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:43:27 user nova-compute[75000]:     </rng>
Nov 06 22:43:27 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:43:27 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:43:27 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:43:27 user nova-compute[75000]:     </memballoon>
Nov 06 22:43:27 user nova-compute[75000]:   </devices>
Nov 06 22:43:27 user nova-compute[75000]: </domain>
Nov 06 22:43:27 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1414744014',display_name='tempest-TestVolumeBootPattern-server-1414744014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1414744014',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-sa7z9djo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:42:57Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=c1c40d17-3fb5-4b5d-9267-02cb7152ce3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:7c,bridge_name='br-int',has_traffic_filtering=True,id=d003f172-c53f-475d-95c8-32c8e48aa486,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd003f172-c5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG os_vif [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:7c,bridge_name='br-int',has_traffic_filtering=True,id=d003f172-c53f-475d-95c8-32c8e48aa486,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd003f172-c5') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f576d60e-af47-5647-9b6e-be84d1550484', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd003f172-c5, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd003f172-c5, col_values=(('qos', UUID('bb7a4b08-f85b-4cb5-a1dd-9fe64cfd32f6')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd003f172-c5, col_values=(('external_ids', {'iface-id': 'd003f172-c53f-475d-95c8-32c8e48aa486', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:ae:7c', 'vm-uuid': 'c1c40d17-3fb5-4b5d-9267-02cb7152ce3c'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:27 user nova-compute[75000]: INFO os_vif [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:7c,bridge_name='br-int',has_traffic_filtering=True,id=d003f172-c53f-475d-95c8-32c8e48aa486,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd003f172-c5')
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:43:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No VIF found with MAC fa:16:3e:a8:ae:7c, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:28 user nova-compute[75000]: INFO nova.compute.manager [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Terminating instance
Nov 06 22:43:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-7a02d8a4-3042-437a-90d4-9f5e17ed42fc req-f21aaac7-78d9-402d-88d9-11c534d8c008 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received event network-vif-plugged-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7a02d8a4-3042-437a-90d4-9f5e17ed42fc req-f21aaac7-78d9-402d-88d9-11c534d8c008 service nova] Acquiring lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7a02d8a4-3042-437a-90d4-9f5e17ed42fc req-f21aaac7-78d9-402d-88d9-11c534d8c008 service nova] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7a02d8a4-3042-437a-90d4-9f5e17ed42fc req-f21aaac7-78d9-402d-88d9-11c534d8c008 service nova] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-7a02d8a4-3042-437a-90d4-9f5e17ed42fc req-f21aaac7-78d9-402d-88d9-11c534d8c008 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] No waiting events found dispatching network-vif-plugged-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:29 user nova-compute[75000]: WARNING nova.compute.manager [req-7a02d8a4-3042-437a-90d4-9f5e17ed42fc req-f21aaac7-78d9-402d-88d9-11c534d8c008 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received unexpected event network-vif-plugged-d003f172-c53f-475d-95c8-32c8e48aa486 for instance with vm_state building and task_state spawning.
Nov 06 22:43:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Instance destroyed successfully.
Nov 06 22:43:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'resources' on Instance uuid b06e5a39-e167-40c6-80a8-d70ca8e0ec7f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:37:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-71151378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-71151378',id=28,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-36i77wnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:41:44Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=b06e5a39-e167-40c6-80a8-d70ca8e0ec7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "address": "fa:16:3e:53:2f:f9", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape93a0138-d9", "ovs_interfaceid": "e93a0138-d9ce-4443-86c8-7325fd6fd86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:2f:f9,bridge_name='br-int',has_traffic_filtering=True,id=e93a0138-d9ce-4443-86c8-7325fd6fd86a,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93a0138-d9') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_vif [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:2f:f9,bridge_name='br-int',has_traffic_filtering=True,id=e93a0138-d9ce-4443-86c8-7325fd6fd86a,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93a0138-d9') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape93a0138-d9, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5178ac5-42f8-4fdb-a7b2-952914af1141) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:29 user nova-compute[75000]: INFO os_vif [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:2f:f9,bridge_name='br-int',has_traffic_filtering=True,id=e93a0138-d9ce-4443-86c8-7325fd6fd86a,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93a0138-d9')
Nov 06 22:43:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyuWThg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:43:29 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b599b93c-0bfd-4ac0-9556-5bfbe742af83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:43:29 user nova-compute[75000]: No targets found.
Nov 06 22:43:29 user nova-compute[75000]: iSNS:
Nov 06 22:43:29 user nova-compute[75000]: No targets found.
Nov 06 22:43:29 user nova-compute[75000]: STATIC:
Nov 06 22:43:29 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f
Nov 06 22:43:29 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:43:29 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:43:29 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:43:29 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:43:29 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:43:29 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:43:29 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:43:29 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:43:29 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3
Nov 06 22:43:29 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:43:29 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:43:29 user nova-compute[75000]: FIRMWARE:
Nov 06 22:43:29 user nova-compute[75000]: No targets found.
Nov 06 22:43:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:43:29 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:43:29 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f2caf2-656a-4ef1-8044-9848aebf3950]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f6e4b-cbfc-41ee-ba1d-051c6dfbe879]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:43:29 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:29 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:43:29 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f (non-flash)
Nov 06 22:43:29 user nova-compute[75000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:29 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:43:29 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7a085ec1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f'): ({'sdg'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Removing single pathed devices sdg {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[74df2df5-c0b0-4825-8224-b4d14179729c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4578e9b4-4a18-4b28-b146-ca7a70ae5f66]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flushing IO for device /dev/sdg {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f71b22-46bc-4151-b58f-dfb6ea7d55a5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.064s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a27e60a-612e-4192-a705-be728eb3bfa1]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] SCSI volumes sdg have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23365626163303736', '/dev/disk/by-id/scsi-1SCST_BIO36ea0a24-3ebac0769a523202', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_36ea0a24') {{(pid=86571) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf21a223-c8bb-4772-bb21-bd8fa0398431]: (4, None) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ba4884-54dc-458f-aa3f-96b12a88dc80]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc01e059-c880-40c9-8651-1b0cfa916093]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f, portal: 172.16.0.220,3260]
Nov 06 22:43:29 user nova-compute[75000]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f, portal: 172.16.0.220,3260] successful.
Nov 06 22:43:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4f063c-96fc-4297-84ff-81acd181ad5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4b6eb8-723b-4e98-8918-a7ab12e5f23e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] <== disconnect_volume: return (388ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:43:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Deleting instance files /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f_del
Nov 06 22:43:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Deletion of /opt/stack/data/nova/instances/b06e5a39-e167-40c6-80a8-d70ca8e0ec7f_del complete
Nov 06 22:43:29 user nova-compute[75000]: INFO nova.compute.manager [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 06 22:43:29 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:43:29 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:43:30 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:43:30 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Took 0.41 seconds to deallocate network for instance.
Nov 06 22:43:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-88664de7-681f-4cb4-86ef-68ca6aa4009d req-29d7e362-c2f0-455c-a599-550f89567ed6 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-deleted-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:30 user nova-compute[75000]: INFO nova.compute.manager [req-88664de7-681f-4cb4-86ef-68ca6aa4009d req-29d7e362-c2f0-455c-a599-550f89567ed6 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Neutron deleted interface e93a0138-d9ce-4443-86c8-7325fd6fd86a; detaching it from the instance and deleting it from the info cache
Nov 06 22:43:30 user nova-compute[75000]: DEBUG nova.network.neutron [req-88664de7-681f-4cb4-86ef-68ca6aa4009d req-29d7e362-c2f0-455c-a599-550f89567ed6 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:43:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-88664de7-681f-4cb4-86ef-68ca6aa4009d req-29d7e362-c2f0-455c-a599-550f89567ed6 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Detach interface failed, port_id=e93a0138-d9ce-4443-86c8-7325fd6fd86a, reason: Instance b06e5a39-e167-40c6-80a8-d70ca8e0ec7f could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:43:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received event network-vif-plugged-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] Acquiring lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] No waiting events found dispatching network-vif-plugged-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:31 user nova-compute[75000]: WARNING nova.compute.manager [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received unexpected event network-vif-plugged-d003f172-c53f-475d-95c8-32c8e48aa486 for instance with vm_state building and task_state spawning.
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-unplugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-unplugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-unplugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] Acquiring lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] No waiting events found dispatching network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:43:31 user nova-compute[75000]: WARNING nova.compute.manager [req-758a75d3-8c43-4de1-8982-ec53089e7eee req-cb99c1ca-d5cb-4fd7-bc73-b17bac63b958 service nova] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Received unexpected event network-vif-plugged-e93a0138-d9ce-4443-86c8-7325fd6fd86a for instance with vm_state active and task_state deleting.
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:43:31 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Instance spawned successfully.
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:43:31 user nova-compute[75000]: INFO nova.compute.manager [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: b06e5a39-e167-40c6-80a8-d70ca8e0ec7f] Took 0.92 seconds to detach 1 volumes for instance.
Nov 06 22:43:31 user nova-compute[75000]: INFO nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:31 user nova-compute[75000]: INFO nova.compute.manager [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Took 35.63 seconds to build instance.
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-890e949c-e093-460f-ac9a-2d7bbe71842a tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.828s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:31 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Deleted allocations for instance b06e5a39-e167-40c6-80a8-d70ca8e0ec7f
Nov 06 22:43:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1df18173-9c87-4d53-8f45-8529c75c2b4e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "b06e5a39-e167-40c6-80a8-d70ca8e0ec7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.152s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjMrmsJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:43:35 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:43:35 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:43:35 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02ab9c5-5ab2-4243-862d-6e53ee05bd65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:43:35 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b055c40b-1ebb-4265-862a-8d9a9ee8e1ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7] added
Nov 06 22:43:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82ea55b-266b-47f1-9bcf-493e5cd19491]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ced57d2-800f-41bd-82f5-778ca4fcbdb0]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjMrmsJn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjMrmsJn" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1063b301-385a-408a-869a-c143163a714b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjMrmsJn'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6494ab0-8bc6-4635-ad2f-42f29e778645]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefea1e5-72b0-4597-b19b-58caaf880b20]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a622329-68ca-4b62-a3e4-d44e68000a37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7, portal: 172.16.0.220,3260]
Nov 06 22:43:35 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7, portal: 172.16.0.220,3260] successful.
Nov 06 22:43:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b260012-beaf-4a27-be2e-54c4093ff5c7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeee810-0e30-456e-bdee-fc78a15b1d07]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:43:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f61d082-e9b1-4793-9cb1-c3668a28ff69]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:43:35 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjMrmsJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26535623837303230', 'path': '/dev/sde'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535623837303230', 'path': '/dev/sde'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG nova.objects.instance [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:43:37 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:43:37 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:43:37 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:43:37 user nova-compute[75000]:   <serial>b7d6ceca-a6ef-4959-a9bf-205184fc31b7</serial>
Nov 06 22:43:37 user nova-compute[75000]: </disk>
Nov 06 22:43:37 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No VIF found with MAC fa:16:3e:a2:a0:8b, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-813526ab-7f52-41fb-8882-adde78433299 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.900s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:43:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:43:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:43:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:43:39 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7936MB free_disk=24.972187042236328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 72e24734-35e3-4e5c-9f8a-85d14397387d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c1c40d17-3fb5-4b5d-9267-02cb7152ce3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:43:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:43:40 user nova-compute[75000]: INFO nova.compute.manager [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Detaching volume b7d6ceca-a6ef-4959-a9bf-205184fc31b7
Nov 06 22:43:40 user nova-compute[75000]: INFO nova.virt.block_device [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attempting to driver detach volume b7d6ceca-a6ef-4959-a9bf-205184fc31b7 from mountpoint /dev/vdb
Nov 06 22:43:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Attempting to detach device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:43:40 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:43:40 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:43:40 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:43:40 user nova-compute[75000]:   <serial>b7d6ceca-a6ef-4959-a9bf-205184fc31b7</serial>
Nov 06 22:43:40 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:43:40 user nova-compute[75000]: </disk>
Nov 06 22:43:40 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:43:40 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully detached device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the persistent domain config.
Nov 06 22:43:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:43:40 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:43:40 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:43:40 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:43:40 user nova-compute[75000]:   <serial>b7d6ceca-a6ef-4959-a9bf-205184fc31b7</serial>
Nov 06 22:43:40 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:43:40 user nova-compute[75000]: </disk>
Nov 06 22:43:40 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:43:40 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:43:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:43:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updating instance_info_cache with network_info: [{"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:43:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-d3e6809f-acbd-4763-8d7e-6e748aeab307" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:43:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:43:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:42 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:43:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:50 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:43:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:43:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb is timed out.
Nov 06 22:44:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully detached device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the live domain config.
Nov 06 22:44:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjMrmsJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:44:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfa9d9e-c0a6-45cc-9680-91f503a247d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:44:01 user nova-compute[75000]: No targets found.
Nov 06 22:44:01 user nova-compute[75000]: iSNS:
Nov 06 22:44:01 user nova-compute[75000]: No targets found.
Nov 06 22:44:01 user nova-compute[75000]: STATIC:
Nov 06 22:44:01 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:44:01 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:44:01 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:44:01 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:44:01 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:44:01 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:44:01 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7
Nov 06 22:44:01 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:44:01 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:44:01 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3
Nov 06 22:44:01 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:44:01 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:44:01 user nova-compute[75000]: FIRMWARE:
Nov 06 22:44:01 user nova-compute[75000]: No targets found.
Nov 06 22:44:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:44:01 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:44:01 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f0ebd-a25e-41d4-acc3-6f173c6f985e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[058a60e3-3e48-4da8-bc5b-0bc1d4e1374b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:44:01 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:44:01 user nova-compute[75000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 (non-flash)
Nov 06 22:44:01 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:44:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:44:01 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:44:01 user nova-compute[75000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 (non-flash)
Nov 06 22:44:01 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:44:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b8fc9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7'): ({'sde'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Removing single pathed devices sde {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00f65d5-4be1-4512-999c-166370ad3d19]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b9f550-757f-4ee7-b4b5-24db73e76931]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Flushing IO for device /dev/sde {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c595a0-57b7-4f3a-be6f-84096e9db6f0]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a1a81e-0c10-4eb6-8489-8a3c5f8bbcc0]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30acb50a-3916-476f-9a12-3cbc3f2e1e94]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[456ab45d-85a6-420c-a6d1-480cc2eef928]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7, portal: 172.16.0.220,3260]
Nov 06 22:44:01 user nova-compute[75000]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7, portal: 172.16.0.220,3260] successful.
Nov 06 22:44:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7d6ceca-a6ef-4959-a9bf-205184fc31b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb2b259-d2eb-46af-8c58-15146320af5f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== disconnect_volume: return (357ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:44:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:44:02 user nova-compute[75000]: DEBUG nova.objects.instance [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:44:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-834145ea-82f5-48e4-913a-5fdb86634359 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.162s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:44:11 user nova-compute[75000]: INFO nova.compute.claims [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Claim successful on node user
Nov 06 22:44:11 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:44:11 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:44:12 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:44:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG nova.policy [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9adf42a2f6ae4b83900ab310933a6421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '425b4940d7904d58982aae5a883fc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:44:12 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Creating image(s)
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "/opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "/opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "/opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk 1073741824" returned: 0 in 0.053s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Successfully created port: 0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.210s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Cannot resize image /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:44:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Ensure instance console log exists: /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Successfully updated port: 0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "refresh_cache-df39e1c2-a3f5-4133-a101-4a7320987e72" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquired lock "refresh_cache-df39e1c2-a3f5-4133-a101-4a7320987e72" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-e13008b5-4c7b-4849-b305-4e120759542b req-2b841d2a-a798-4c78-86c7-dd71fd21e707 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received event network-changed-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-e13008b5-4c7b-4849-b305-4e120759542b req-2b841d2a-a798-4c78-86c7-dd71fd21e707 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Refreshing instance network info cache due to event network-changed-0ed826c4-2272-40f7-80a4-f8d4006cd042. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e13008b5-4c7b-4849-b305-4e120759542b req-2b841d2a-a798-4c78-86c7-dd71fd21e707 service nova] Acquiring lock "refresh_cache-df39e1c2-a3f5-4133-a101-4a7320987e72" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:44:13 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Updating instance_info_cache with network_info: [{"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Releasing lock "refresh_cache-df39e1c2-a3f5-4133-a101-4a7320987e72" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Instance network_info: |[{"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e13008b5-4c7b-4849-b305-4e120759542b req-2b841d2a-a798-4c78-86c7-dd71fd21e707 service nova] Acquired lock "refresh_cache-df39e1c2-a3f5-4133-a101-4a7320987e72" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-e13008b5-4c7b-4849-b305-4e120759542b req-2b841d2a-a798-4c78-86c7-dd71fd21e707 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Refreshing network info cache for port 0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Start _get_guest_xml network_info=[{"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:44:14 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:44:14 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1598449580',display_name='tempest-AttachVolumeTestJSON-server-1598449580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1598449580',id=36,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYyU+BsuyGlPdSHdD8qCv7Q/U5LOwBOGo1rM6Qb03ZlbOhLH3LWxt1tY1YzUeSlWuSY3feFSF91KNzhNMIptGFdAHHAuZrRneNrSMRT+SRGF4Ed46RNVwQVh0bNn18lhA==',key_name='tempest-keypair-841911276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-b4px2meq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=df39e1c2-a3f5-4133-a101-4a7320987e72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:14:63,bridge_name='br-int',has_traffic_filtering=True,id=0ed826c4-2272-40f7-80a4-f8d4006cd042,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed826c4-22') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'pci_devices' on Instance uuid df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:44:14 user nova-compute[75000]:   <uuid>df39e1c2-a3f5-4133-a101-4a7320987e72</uuid>
Nov 06 22:44:14 user nova-compute[75000]:   <name>instance-00000024</name>
Nov 06 22:44:14 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:44:14 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:44:14 user nova-compute[75000]:   <metadata>
Nov 06 22:44:14 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:44:14 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:44:14 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeTestJSON-server-1598449580</nova:name>
Nov 06 22:44:14 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:44:14</nova:creationTime>
Nov 06 22:44:14 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:44:14 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:44:14 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:44:14 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:44:14 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:44:14 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:44:14 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:44:14 user nova-compute[75000]:       <nova:owner>
Nov 06 22:44:14 user nova-compute[75000]:         <nova:user uuid="9adf42a2f6ae4b83900ab310933a6421">tempest-AttachVolumeTestJSON-738638018-project-member</nova:user>
Nov 06 22:44:14 user nova-compute[75000]:         <nova:project uuid="425b4940d7904d58982aae5a883fc3ed">tempest-AttachVolumeTestJSON-738638018</nova:project>
Nov 06 22:44:14 user nova-compute[75000]:       </nova:owner>
Nov 06 22:44:14 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:44:14 user nova-compute[75000]:       <nova:ports>
Nov 06 22:44:14 user nova-compute[75000]:         <nova:port uuid="0ed826c4-2272-40f7-80a4-f8d4006cd042">
Nov 06 22:44:14 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 22:44:14 user nova-compute[75000]:         </nova:port>
Nov 06 22:44:14 user nova-compute[75000]:       </nova:ports>
Nov 06 22:44:14 user nova-compute[75000]:     </nova:instance>
Nov 06 22:44:14 user nova-compute[75000]:   </metadata>
Nov 06 22:44:14 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:44:14 user nova-compute[75000]:     <system>
Nov 06 22:44:14 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:44:14 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:44:14 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:44:14 user nova-compute[75000]:       <entry name="serial">df39e1c2-a3f5-4133-a101-4a7320987e72</entry>
Nov 06 22:44:14 user nova-compute[75000]:       <entry name="uuid">df39e1c2-a3f5-4133-a101-4a7320987e72</entry>
Nov 06 22:44:14 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:44:14 user nova-compute[75000]:     </system>
Nov 06 22:44:14 user nova-compute[75000]:   </sysinfo>
Nov 06 22:44:14 user nova-compute[75000]:   <os>
Nov 06 22:44:14 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:44:14 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:44:14 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:44:14 user nova-compute[75000]:   </os>
Nov 06 22:44:14 user nova-compute[75000]:   <features>
Nov 06 22:44:14 user nova-compute[75000]:     <acpi/>
Nov 06 22:44:14 user nova-compute[75000]:     <apic/>
Nov 06 22:44:14 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:44:14 user nova-compute[75000]:   </features>
Nov 06 22:44:14 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:44:14 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:44:14 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:44:14 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:44:14 user nova-compute[75000]:   </clock>
Nov 06 22:44:14 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:44:14 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:44:14 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:44:14 user nova-compute[75000]:   </cpu>
Nov 06 22:44:14 user nova-compute[75000]:   <devices>
Nov 06 22:44:14 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:44:14 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:44:14 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk"/>
Nov 06 22:44:14 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:44:14 user nova-compute[75000]:     </disk>
Nov 06 22:44:14 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:44:14 user nova-compute[75000]:       <mac address="fa:16:3e:f1:14:63"/>
Nov 06 22:44:14 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:44:14 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:44:14 user nova-compute[75000]:       <target dev="tap0ed826c4-22"/>
Nov 06 22:44:14 user nova-compute[75000]:     </interface>
Nov 06 22:44:14 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:44:14 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/console.log" append="off"/>
Nov 06 22:44:14 user nova-compute[75000]:     </serial>
Nov 06 22:44:14 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:44:14 user nova-compute[75000]:     <video>
Nov 06 22:44:14 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:44:14 user nova-compute[75000]:     </video>
Nov 06 22:44:14 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:44:14 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:44:14 user nova-compute[75000]:     </rng>
Nov 06 22:44:14 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:44:14 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:44:14 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:44:14 user nova-compute[75000]:     </memballoon>
Nov 06 22:44:14 user nova-compute[75000]:   </devices>
Nov 06 22:44:14 user nova-compute[75000]: </domain>
Nov 06 22:44:14 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1598449580',display_name='tempest-AttachVolumeTestJSON-server-1598449580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1598449580',id=36,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYyU+BsuyGlPdSHdD8qCv7Q/U5LOwBOGo1rM6Qb03ZlbOhLH3LWxt1tY1YzUeSlWuSY3feFSF91KNzhNMIptGFdAHHAuZrRneNrSMRT+SRGF4Ed46RNVwQVh0bNn18lhA==',key_name='tempest-keypair-841911276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-b4px2meq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=df39e1c2-a3f5-4133-a101-4a7320987e72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:14:63,bridge_name='br-int',has_traffic_filtering=True,id=0ed826c4-2272-40f7-80a4-f8d4006cd042,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed826c4-22') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG os_vif [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:14:63,bridge_name='br-int',has_traffic_filtering=True,id=0ed826c4-2272-40f7-80a4-f8d4006cd042,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed826c4-22') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68b4a89f-fbac-55c6-8740-8fc384f9f0ac', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ed826c4-22, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ed826c4-22, col_values=(('qos', UUID('c9862a0c-20d2-4b72-82d9-644b5c397c76')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ed826c4-22, col_values=(('external_ids', {'iface-id': '0ed826c4-2272-40f7-80a4-f8d4006cd042', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:14:63', 'vm-uuid': 'df39e1c2-a3f5-4133-a101-4a7320987e72'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:14 user nova-compute[75000]: INFO os_vif [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:14:63,bridge_name='br-int',has_traffic_filtering=True,id=0ed826c4-2272-40f7-80a4-f8d4006cd042,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed826c4-22')
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No VIF found with MAC fa:16:3e:f1:14:63, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-e13008b5-4c7b-4849-b305-4e120759542b req-2b841d2a-a798-4c78-86c7-dd71fd21e707 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Updated VIF entry in instance network info cache for port 0ed826c4-2272-40f7-80a4-f8d4006cd042. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-e13008b5-4c7b-4849-b305-4e120759542b req-2b841d2a-a798-4c78-86c7-dd71fd21e707 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Updating instance_info_cache with network_info: [{"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e13008b5-4c7b-4849-b305-4e120759542b req-2b841d2a-a798-4c78-86c7-dd71fd21e707 service nova] Releasing lock "refresh_cache-df39e1c2-a3f5-4133-a101-4a7320987e72" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:44:14 user nova-compute[75000]: INFO nova.compute.claims [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Claim successful on node user
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:44:15 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.policy [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd288b4ec7d714054aefff906d8070a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c00b052f634d689bfa3e28ffce3d95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:44:15 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Creating image(s)
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "/opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "/opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-1c46bae2-6368-4dfa-9637-6423231a6dac req-5e848b96-20ae-484f-9441-8223af5224c0 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received event network-vif-plugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1c46bae2-6368-4dfa-9637-6423231a6dac req-5e848b96-20ae-484f-9441-8223af5224c0 service nova] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1c46bae2-6368-4dfa-9637-6423231a6dac req-5e848b96-20ae-484f-9441-8223af5224c0 service nova] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1c46bae2-6368-4dfa-9637-6423231a6dac req-5e848b96-20ae-484f-9441-8223af5224c0 service nova] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-1c46bae2-6368-4dfa-9637-6423231a6dac req-5e848b96-20ae-484f-9441-8223af5224c0 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] No waiting events found dispatching network-vif-plugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:44:15 user nova-compute[75000]: WARNING nova.compute.manager [req-1c46bae2-6368-4dfa-9637-6423231a6dac req-5e848b96-20ae-484f-9441-8223af5224c0 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received unexpected event network-vif-plugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 for instance with vm_state building and task_state spawning.
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk 1073741824" returned: 0 in 0.085s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Successfully created port: e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Cannot resize image /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Ensure instance console log exists: /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Successfully updated port: e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "refresh_cache-2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquired lock "refresh_cache-2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-36ce5abc-29fe-4c58-bded-a01f82d3f0a8 req-692b70e9-6569-4e84-a9bb-31b9f5d0a6e0 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received event network-changed-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-36ce5abc-29fe-4c58-bded-a01f82d3f0a8 req-692b70e9-6569-4e84-a9bb-31b9f5d0a6e0 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Refreshing instance network info cache due to event network-changed-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-36ce5abc-29fe-4c58-bded-a01f82d3f0a8 req-692b70e9-6569-4e84-a9bb-31b9f5d0a6e0 service nova] Acquiring lock "refresh_cache-2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:44:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Updating instance_info_cache with network_info: [{"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Releasing lock "refresh_cache-2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Instance network_info: |[{"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-36ce5abc-29fe-4c58-bded-a01f82d3f0a8 req-692b70e9-6569-4e84-a9bb-31b9f5d0a6e0 service nova] Acquired lock "refresh_cache-2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.network.neutron [req-36ce5abc-29fe-4c58-bded-a01f82d3f0a8 req-692b70e9-6569-4e84-a9bb-31b9f5d0a6e0 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Refreshing network info cache for port e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Start _get_guest_xml network_info=[{"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:44:17 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:44:17 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1627674095',display_name='tempest-VolumesSnapshotTestJSON-instance-1627674095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1627674095',id=37,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+L1FwKSCo3s0QAnniUI38+wOonjxvDGgASnGd/GKAXJKDYOdKEVCZIa2eeKATgi53+2iLtVH/14lqFQjgmGPaegnUsHb63MLfTcXRY9PX629LnyN2HPiphX15zjkRIqw==',key_name='tempest-keypair-1311213786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c00b052f634d689bfa3e28ffce3d95',ramdisk_id='',reservation_id='r-mdxrnv78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-549753594',owner_user_name='tempest-VolumesSnapshotTestJSON-549753594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d288b4ec7d714054aefff906d8070a5d',uuid=2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converting VIF {"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=e554e8e5-e5e6-4ff6-a487-b2f37fc616d3,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554e8e5-e5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.objects.instance [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:44:17 user nova-compute[75000]:   <uuid>2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3</uuid>
Nov 06 22:44:17 user nova-compute[75000]:   <name>instance-00000025</name>
Nov 06 22:44:17 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:44:17 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:44:17 user nova-compute[75000]:   <metadata>
Nov 06 22:44:17 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:44:17 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:44:17 user nova-compute[75000]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1627674095</nova:name>
Nov 06 22:44:17 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:44:17</nova:creationTime>
Nov 06 22:44:17 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:44:17 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:44:17 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:44:17 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:44:17 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:44:17 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:44:17 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:44:17 user nova-compute[75000]:       <nova:owner>
Nov 06 22:44:17 user nova-compute[75000]:         <nova:user uuid="d288b4ec7d714054aefff906d8070a5d">tempest-VolumesSnapshotTestJSON-549753594-project-member</nova:user>
Nov 06 22:44:17 user nova-compute[75000]:         <nova:project uuid="85c00b052f634d689bfa3e28ffce3d95">tempest-VolumesSnapshotTestJSON-549753594</nova:project>
Nov 06 22:44:17 user nova-compute[75000]:       </nova:owner>
Nov 06 22:44:17 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:44:17 user nova-compute[75000]:       <nova:ports>
Nov 06 22:44:17 user nova-compute[75000]:         <nova:port uuid="e554e8e5-e5e6-4ff6-a487-b2f37fc616d3">
Nov 06 22:44:17 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 22:44:17 user nova-compute[75000]:         </nova:port>
Nov 06 22:44:17 user nova-compute[75000]:       </nova:ports>
Nov 06 22:44:17 user nova-compute[75000]:     </nova:instance>
Nov 06 22:44:17 user nova-compute[75000]:   </metadata>
Nov 06 22:44:17 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:44:17 user nova-compute[75000]:     <system>
Nov 06 22:44:17 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:44:17 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:44:17 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:44:17 user nova-compute[75000]:       <entry name="serial">2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3</entry>
Nov 06 22:44:17 user nova-compute[75000]:       <entry name="uuid">2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3</entry>
Nov 06 22:44:17 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:44:17 user nova-compute[75000]:     </system>
Nov 06 22:44:17 user nova-compute[75000]:   </sysinfo>
Nov 06 22:44:17 user nova-compute[75000]:   <os>
Nov 06 22:44:17 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:44:17 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:44:17 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:44:17 user nova-compute[75000]:   </os>
Nov 06 22:44:17 user nova-compute[75000]:   <features>
Nov 06 22:44:17 user nova-compute[75000]:     <acpi/>
Nov 06 22:44:17 user nova-compute[75000]:     <apic/>
Nov 06 22:44:17 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:44:17 user nova-compute[75000]:   </features>
Nov 06 22:44:17 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:44:17 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:44:17 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:44:17 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:44:17 user nova-compute[75000]:   </clock>
Nov 06 22:44:17 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:44:17 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:44:17 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:44:17 user nova-compute[75000]:   </cpu>
Nov 06 22:44:17 user nova-compute[75000]:   <devices>
Nov 06 22:44:17 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:44:17 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:44:17 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk"/>
Nov 06 22:44:17 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:44:17 user nova-compute[75000]:     </disk>
Nov 06 22:44:17 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:44:17 user nova-compute[75000]:       <mac address="fa:16:3e:65:19:c4"/>
Nov 06 22:44:17 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:44:17 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:44:17 user nova-compute[75000]:       <target dev="tape554e8e5-e5"/>
Nov 06 22:44:17 user nova-compute[75000]:     </interface>
Nov 06 22:44:17 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:44:17 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/console.log" append="off"/>
Nov 06 22:44:17 user nova-compute[75000]:     </serial>
Nov 06 22:44:17 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:44:17 user nova-compute[75000]:     <video>
Nov 06 22:44:17 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:44:17 user nova-compute[75000]:     </video>
Nov 06 22:44:17 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:44:17 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:44:17 user nova-compute[75000]:     </rng>
Nov 06 22:44:17 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:44:17 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:44:17 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:44:17 user nova-compute[75000]:     </memballoon>
Nov 06 22:44:17 user nova-compute[75000]:   </devices>
Nov 06 22:44:17 user nova-compute[75000]: </domain>
Nov 06 22:44:17 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1627674095',display_name='tempest-VolumesSnapshotTestJSON-instance-1627674095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1627674095',id=37,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+L1FwKSCo3s0QAnniUI38+wOonjxvDGgASnGd/GKAXJKDYOdKEVCZIa2eeKATgi53+2iLtVH/14lqFQjgmGPaegnUsHb63MLfTcXRY9PX629LnyN2HPiphX15zjkRIqw==',key_name='tempest-keypair-1311213786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c00b052f634d689bfa3e28ffce3d95',ramdisk_id='',reservation_id='r-mdxrnv78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-549753594',owner_user_name='tempest-VolumesSnapshotTestJSON-549753594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d288b4ec7d714054aefff906d8070a5d',uuid=2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converting VIF {"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=e554e8e5-e5e6-4ff6-a487-b2f37fc616d3,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554e8e5-e5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG os_vif [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=e554e8e5-e5e6-4ff6-a487-b2f37fc616d3,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554e8e5-e5') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '053a26a8-3380-5c08-9059-a02f05d94aed', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape554e8e5-e5, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape554e8e5-e5, col_values=(('qos', UUID('b035f176-3b07-40a9-86a9-54d52a19d2bf')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape554e8e5-e5, col_values=(('external_ids', {'iface-id': 'e554e8e5-e5e6-4ff6-a487-b2f37fc616d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:19:c4', 'vm-uuid': '2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:17 user nova-compute[75000]: INFO os_vif [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=e554e8e5-e5e6-4ff6-a487-b2f37fc616d3,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554e8e5-e5')
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No VIF found with MAC fa:16:3e:65:19:c4, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.network.neutron [req-36ce5abc-29fe-4c58-bded-a01f82d3f0a8 req-692b70e9-6569-4e84-a9bb-31b9f5d0a6e0 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Updated VIF entry in instance network info cache for port e554e8e5-e5e6-4ff6-a487-b2f37fc616d3. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.network.neutron [req-36ce5abc-29fe-4c58-bded-a01f82d3f0a8 req-692b70e9-6569-4e84-a9bb-31b9f5d0a6e0 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Updating instance_info_cache with network_info: [{"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-36ce5abc-29fe-4c58-bded-a01f82d3f0a8 req-692b70e9-6569-4e84-a9bb-31b9f5d0a6e0 service nova] Releasing lock "refresh_cache-2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-b09239ef-9f64-4c08-8647-f119642471e4 req-c38ebfd7-d09d-4c88-8554-a9d67dcdc07e service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received event network-vif-plugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b09239ef-9f64-4c08-8647-f119642471e4 req-c38ebfd7-d09d-4c88-8554-a9d67dcdc07e service nova] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b09239ef-9f64-4c08-8647-f119642471e4 req-c38ebfd7-d09d-4c88-8554-a9d67dcdc07e service nova] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b09239ef-9f64-4c08-8647-f119642471e4 req-c38ebfd7-d09d-4c88-8554-a9d67dcdc07e service nova] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-b09239ef-9f64-4c08-8647-f119642471e4 req-c38ebfd7-d09d-4c88-8554-a9d67dcdc07e service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] No waiting events found dispatching network-vif-plugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:44:17 user nova-compute[75000]: WARNING nova.compute.manager [req-b09239ef-9f64-4c08-8647-f119642471e4 req-c38ebfd7-d09d-4c88-8554-a9d67dcdc07e service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received unexpected event network-vif-plugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 for instance with vm_state building and task_state spawning.
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:44:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Instance spawned successfully.
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:18 user nova-compute[75000]: INFO nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 06 22:44:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:44:18 user nova-compute[75000]: INFO nova.compute.manager [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Took 6.95 seconds to build instance.
Nov 06 22:44:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8bc47e9a-a9a3-415a-8704-9afe7f3d1498 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.074s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-3c7d7e7b-94ce-4e4c-b2f1-a9efb6410b2e req-7ebb119b-94bc-43f5-9b71-b9a026ef2adc service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received event network-vif-plugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3c7d7e7b-94ce-4e4c-b2f1-a9efb6410b2e req-7ebb119b-94bc-43f5-9b71-b9a026ef2adc service nova] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3c7d7e7b-94ce-4e4c-b2f1-a9efb6410b2e req-7ebb119b-94bc-43f5-9b71-b9a026ef2adc service nova] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3c7d7e7b-94ce-4e4c-b2f1-a9efb6410b2e req-7ebb119b-94bc-43f5-9b71-b9a026ef2adc service nova] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-3c7d7e7b-94ce-4e4c-b2f1-a9efb6410b2e req-7ebb119b-94bc-43f5-9b71-b9a026ef2adc service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] No waiting events found dispatching network-vif-plugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:44:19 user nova-compute[75000]: WARNING nova.compute.manager [req-3c7d7e7b-94ce-4e4c-b2f1-a9efb6410b2e req-7ebb119b-94bc-43f5-9b71-b9a026ef2adc service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received unexpected event network-vif-plugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 for instance with vm_state building and task_state spawning.
Nov 06 22:44:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "9e161f93-64e3-4807-8811-d7d6ba821ca9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:19 user nova-compute[75000]: INFO nova.compute.manager [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Terminating instance
Nov 06 22:44:19 user nova-compute[75000]: DEBUG nova.compute.manager [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:20 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Instance destroyed successfully.
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.objects.instance [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'resources' on Instance uuid 9e161f93-64e3-4807-8811-d7d6ba821ca9 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:34:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1473309591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1473309591',id=23,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:34:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-3mxzwtas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:36:03Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=9e161f93-64e3-4807-8811-d7d6ba821ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "address": "fa:16:3e:cf:61:5f", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7436fc9-b4", "ovs_interfaceid": "d7436fc9-b4b3-4b82-aa01-aac71e6aafb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=d7436fc9-b4b3-4b82-aa01-aac71e6aafb9,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7436fc9-b4') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG os_vif [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=d7436fc9-b4b3-4b82-aa01-aac71e6aafb9,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7436fc9-b4') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7436fc9-b4, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81b65467-fa2d-494a-ac63-65309aaecf9d) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:20 user nova-compute[75000]: INFO os_vif [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:61:5f,bridge_name='br-int',has_traffic_filtering=True,id=d7436fc9-b4b3-4b82-aa01-aac71e6aafb9,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7436fc9-b4')
Nov 06 22:44:20 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Deleting instance files /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9_del
Nov 06 22:44:20 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Deletion of /opt/stack/data/nova/instances/9e161f93-64e3-4807-8811-d7d6ba821ca9_del complete
Nov 06 22:44:20 user nova-compute[75000]: INFO nova.compute.manager [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 06 22:44:20 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-078af38f-a210-4465-97c1-703baf4003e4 req-e0d9e1ba-7998-4b8e-b6e8-c896e217de91 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received event network-vif-deleted-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:20 user nova-compute[75000]: INFO nova.compute.manager [req-078af38f-a210-4465-97c1-703baf4003e4 req-e0d9e1ba-7998-4b8e-b6e8-c896e217de91 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Neutron deleted interface d7436fc9-b4b3-4b82-aa01-aac71e6aafb9; detaching it from the instance and deleting it from the info cache
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.network.neutron [req-078af38f-a210-4465-97c1-703baf4003e4 req-e0d9e1ba-7998-4b8e-b6e8-c896e217de91 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:20 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Took 0.46 seconds to deallocate network for instance.
Nov 06 22:44:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-078af38f-a210-4465-97c1-703baf4003e4 req-e0d9e1ba-7998-4b8e-b6e8-c896e217de91 service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Detach interface failed, port_id=d7436fc9-b4b3-4b82-aa01-aac71e6aafb9, reason: Instance 9e161f93-64e3-4807-8811-d7d6ba821ca9 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:21 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Deleted allocations for instance 9e161f93-64e3-4807-8811-d7d6ba821ca9
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received event network-vif-plugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] No waiting events found dispatching network-vif-plugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:44:21 user nova-compute[75000]: WARNING nova.compute.manager [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received unexpected event network-vif-plugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 for instance with vm_state building and task_state spawning.
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received event network-vif-unplugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] Acquiring lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] No waiting events found dispatching network-vif-unplugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:44:21 user nova-compute[75000]: WARNING nova.compute.manager [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received unexpected event network-vif-unplugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 for instance with vm_state deleted and task_state None.
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received event network-vif-plugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] Acquiring lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] No waiting events found dispatching network-vif-plugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:44:21 user nova-compute[75000]: WARNING nova.compute.manager [req-2a0b419d-335f-484a-9b91-12557cd40ccc req-66933470-a844-475f-98aa-8b867924669a service nova] [instance: 9e161f93-64e3-4807-8811-d7d6ba821ca9] Received unexpected event network-vif-plugged-d7436fc9-b4b3-4b82-aa01-aac71e6aafb9 for instance with vm_state deleted and task_state None.
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:44:21 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Instance spawned successfully.
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-44a4e793-fc16-4f15-a0c0-63b7d6eb8962 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "9e161f93-64e3-4807-8811-d7d6ba821ca9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:21 user nova-compute[75000]: INFO nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 06 22:44:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:44:21 user nova-compute[75000]: INFO nova.compute.manager [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Took 6.81 seconds to build instance.
Nov 06 22:44:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d13fcbe0-32d1-4fd7-afe3-3b0546d845dc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.906s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:44:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:36 user nova-compute[75000]: INFO nova.compute.manager [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attaching volume 18aa7838-94b0-4cb4-9c5a-483aef8dbacb to /dev/vdb
Nov 06 22:44:36 user nova-compute[75000]: DEBUG os_brick.utils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7d7c81-c8d5-4a5a-b81b-956ddacef09c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde4a1d7-af2f-443a-8646-eb4862852f75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e2c48-3b35-4145-84b0-63a26816b264]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fb9448-b24d-4843-91eb-c14d76c221ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:44:37 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:44:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fca4ea6-cc4c-4a5b-93ea-53e7e235c75d]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG os_brick.utils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating existing volume attachment record: 7399c849-71f1-4388-bf1e-c85d6db53a0b {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating instance_info_cache with network_info: [{"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:44:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:41 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:44:41 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.03250503540039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d3e6809f-acbd-4763-8d7e-6e748aeab307 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 72e24734-35e3-4e5c-9f8a-85d14397387d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c1c40d17-3fb5-4b5d-9267-02cb7152ce3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance df39e1c2-a3f5-4133-a101-4a7320987e72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:44:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-fe9a0a0c-03c9-4301-8a3d-974c1a576ae1 req-d1a2699e-2e6c-4627-83f0-403d608fb18f service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received event network-changed-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-fe9a0a0c-03c9-4301-8a3d-974c1a576ae1 req-d1a2699e-2e6c-4627-83f0-403d608fb18f service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Refreshing instance network info cache due to event network-changed-a2cfad28-beca-4749-8335-a2a69ddcc677. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:44:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fe9a0a0c-03c9-4301-8a3d-974c1a576ae1 req-d1a2699e-2e6c-4627-83f0-403d608fb18f service nova] Acquiring lock "refresh_cache-72e24734-35e3-4e5c-9f8a-85d14397387d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:44:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fe9a0a0c-03c9-4301-8a3d-974c1a576ae1 req-d1a2699e-2e6c-4627-83f0-403d608fb18f service nova] Acquired lock "refresh_cache-72e24734-35e3-4e5c-9f8a-85d14397387d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:44:42 user nova-compute[75000]: DEBUG nova.network.neutron [req-fe9a0a0c-03c9-4301-8a3d-974c1a576ae1 req-d1a2699e-2e6c-4627-83f0-403d608fb18f service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Refreshing network info cache for port a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:44:42 user nova-compute[75000]: DEBUG nova.network.neutron [req-fe9a0a0c-03c9-4301-8a3d-974c1a576ae1 req-d1a2699e-2e6c-4627-83f0-403d608fb18f service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Updated VIF entry in instance network info cache for port a2cfad28-beca-4749-8335-a2a69ddcc677. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:44:42 user nova-compute[75000]: DEBUG nova.network.neutron [req-fe9a0a0c-03c9-4301-8a3d-974c1a576ae1 req-d1a2699e-2e6c-4627-83f0-403d608fb18f service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Updating instance_info_cache with network_info: [{"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fe9a0a0c-03c9-4301-8a3d-974c1a576ae1 req-d1a2699e-2e6c-4627-83f0-403d608fb18f service nova] Releasing lock "refresh_cache-72e24734-35e3-4e5c-9f8a-85d14397387d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:44:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:44:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:44:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:44:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:44:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:44:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:44:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:45 user nova-compute[75000]: INFO nova.compute.manager [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Unshelving
Nov 06 22:44:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:45 user nova-compute[75000]: INFO nova.virt.block_device [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Booting with volume 2d15d74e-17fa-4d73-9445-4a19e172499e at /dev/vdc
Nov 06 22:44:45 user nova-compute[75000]: DEBUG os_brick.utils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:45 user nova-compute[75000]: INFO nova.compute.manager [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Terminating instance
Nov 06 22:44:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[12611e9a-ea47-487b-ab73-cf8ba9b8f757]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[62db58dc-9ba6-46b8-9d54-242a417c7fcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae1a4bb-f134-4399-89ac-f0ea3d827d7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[46abae79-bc6a-49bf-a880-712f21bff545]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:44:46 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbc9f56-af3b-41e4-8cd7-cde2a2a5a0de]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.utils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updating existing volume attachment record: 729256a0-e959-448a-baa2-826baa992f7e {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-526c62ef-c95c-4130-8cf1-9db4bfa6fcfd req-f0eab0d8-3a97-40e6-a48e-1e10de58f0dd service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received event network-vif-unplugged-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-526c62ef-c95c-4130-8cf1-9db4bfa6fcfd req-f0eab0d8-3a97-40e6-a48e-1e10de58f0dd service nova] Acquiring lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-526c62ef-c95c-4130-8cf1-9db4bfa6fcfd req-f0eab0d8-3a97-40e6-a48e-1e10de58f0dd service nova] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-526c62ef-c95c-4130-8cf1-9db4bfa6fcfd req-f0eab0d8-3a97-40e6-a48e-1e10de58f0dd service nova] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-526c62ef-c95c-4130-8cf1-9db4bfa6fcfd req-f0eab0d8-3a97-40e6-a48e-1e10de58f0dd service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] No waiting events found dispatching network-vif-unplugged-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-526c62ef-c95c-4130-8cf1-9db4bfa6fcfd req-f0eab0d8-3a97-40e6-a48e-1e10de58f0dd service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received event network-vif-unplugged-d003f172-c53f-475d-95c8-32c8e48aa486 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Instance destroyed successfully.
Nov 06 22:44:46 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'resources' on Instance uuid c1c40d17-3fb5-4b5d-9267-02cb7152ce3c {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1414744014',display_name='tempest-TestVolumeBootPattern-server-1414744014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1414744014',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:43:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-sa7z9djo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:43:31Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=c1c40d17-3fb5-4b5d-9267-02cb7152ce3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "d003f172-c53f-475d-95c8-32c8e48aa486", "address": "fa:16:3e:a8:ae:7c", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd003f172-c5", "ovs_interfaceid": "d003f172-c53f-475d-95c8-32c8e48aa486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:7c,bridge_name='br-int',has_traffic_filtering=True,id=d003f172-c53f-475d-95c8-32c8e48aa486,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd003f172-c5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_vif [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:7c,bridge_name='br-int',has_traffic_filtering=True,id=d003f172-c53f-475d-95c8-32c8e48aa486,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd003f172-c5') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd003f172-c5, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb7a4b08-f85b-4cb5-a1dd-9fe64cfd32f6) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:46 user nova-compute[75000]: INFO os_vif [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ae:7c,bridge_name='br-int',has_traffic_filtering=True,id=d003f172-c53f-475d-95c8-32c8e48aa486,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd003f172-c5')
Nov 06 22:44:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uTDFqxSf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:44:46 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96607f62-c50d-493f-95d5-674fb49a1a37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:44:46 user nova-compute[75000]: No targets found.
Nov 06 22:44:46 user nova-compute[75000]: iSNS:
Nov 06 22:44:46 user nova-compute[75000]: No targets found.
Nov 06 22:44:46 user nova-compute[75000]: STATIC:
Nov 06 22:44:46 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:44:46 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:44:46 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:44:46 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:44:46 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:44:46 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:44:46 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3
Nov 06 22:44:46 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:44:46 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:44:46 user nova-compute[75000]: FIRMWARE:
Nov 06 22:44:46 user nova-compute[75000]: No targets found.
Nov 06 22:44:46 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:44:46 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:44:46 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a86816-d48f-43b1-80ac-75ac0dc15e91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ba8e7a-14b4-4ef8-ad56-4139ee2a11db]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:44:46 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:44:46 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:44:46 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:44:46 user nova-compute[75000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 (non-flash)
Nov 06 22:44:46 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:44:46 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b8fca170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f6e0bf-a6a6-4da2-81c3-e829c75151e8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df691c7-ecbc-483d-8e67-27c3fd7074d5]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d11e98-508d-4cee-8e2f-365f72b9ace6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:44:46 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10e67c8-f439-4c4f-9fde-c563a199fea3]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1e5bbe3d', '/dev/disk/by-id/scsi-23862386430356433', '/dev/disk/by-id/scsi-1SCST_BIO1e5bbe3d-8b8d05d3100ac55a') {{(pid=86571) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d537a26-4ed2-4a18-9e4c-ae8f75edd7cb]: (4, None) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f169b4-0d6b-4693-afd4-863063144b56]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[286f80e3-19ca-420c-b893-67ef1a3cdc4c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3, portal: 172.16.0.220,3260]
Nov 06 22:44:47 user nova-compute[75000]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3, portal: 172.16.0.220,3260] successful.
Nov 06 22:44:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8422b892-b515-4efc-a2af-2989f0a672d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a63eb51-258d-4ab9-924f-0357e66543cd]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== disconnect_volume: return (381ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:44:47 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Deleting instance files /opt/stack/data/nova/instances/c1c40d17-3fb5-4b5d-9267-02cb7152ce3c_del
Nov 06 22:44:47 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Deletion of /opt/stack/data/nova/instances/c1c40d17-3fb5-4b5d-9267-02cb7152ce3c_del complete
Nov 06 22:44:47 user nova-compute[75000]: INFO nova.compute.manager [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 06 22:44:47 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:47 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Took 0.48 seconds to deallocate network for instance.
Nov 06 22:44:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-737f38e9-06c7-4f89-a183-cb4ca32e2897 req-60d9f60c-a34a-4b57-b609-2388223880a2 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received event network-vif-deleted-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:47 user nova-compute[75000]: INFO nova.compute.manager [req-737f38e9-06c7-4f89-a183-cb4ca32e2897 req-60d9f60c-a34a-4b57-b609-2388223880a2 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Neutron deleted interface d003f172-c53f-475d-95c8-32c8e48aa486; detaching it from the instance and deleting it from the info cache
Nov 06 22:44:47 user nova-compute[75000]: DEBUG nova.network.neutron [req-737f38e9-06c7-4f89-a183-cb4ca32e2897 req-60d9f60c-a34a-4b57-b609-2388223880a2 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:44:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-737f38e9-06c7-4f89-a183-cb4ca32e2897 req-60d9f60c-a34a-4b57-b609-2388223880a2 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Detach interface failed, port_id=d003f172-c53f-475d-95c8-32c8e48aa486, reason: Instance c1c40d17-3fb5-4b5d-9267-02cb7152ce3c could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:44:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-bba312b1-3130-4262-b4df-210286d19fa8 req-67abbf79-bd2a-497a-aabd-5d5ea91eb698 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received event network-vif-plugged-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:44:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bba312b1-3130-4262-b4df-210286d19fa8 req-67abbf79-bd2a-497a-aabd-5d5ea91eb698 service nova] Acquiring lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bba312b1-3130-4262-b4df-210286d19fa8 req-67abbf79-bd2a-497a-aabd-5d5ea91eb698 service nova] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bba312b1-3130-4262-b4df-210286d19fa8 req-67abbf79-bd2a-497a-aabd-5d5ea91eb698 service nova] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-bba312b1-3130-4262-b4df-210286d19fa8 req-67abbf79-bd2a-497a-aabd-5d5ea91eb698 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] No waiting events found dispatching network-vif-plugged-d003f172-c53f-475d-95c8-32c8e48aa486 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:44:48 user nova-compute[75000]: WARNING nova.compute.manager [req-bba312b1-3130-4262-b4df-210286d19fa8 req-67abbf79-bd2a-497a-aabd-5d5ea91eb698 service nova] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Received unexpected event network-vif-plugged-d003f172-c53f-475d-95c8-32c8e48aa486 for instance with vm_state active and task_state deleting.
Nov 06 22:44:48 user nova-compute[75000]: INFO nova.compute.manager [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Took 0.98 seconds to detach 1 volumes for instance.
Nov 06 22:44:48 user nova-compute[75000]: DEBUG nova.compute.manager [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: c1c40d17-3fb5-4b5d-9267-02cb7152ce3c] Deleting volume: 8422b892-b515-4efc-a2af-2989f0a672d3 {{(pid=75000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'flavor' on Instance uuid 72e24734-35e3-4e5c-9f8a-85d14397387d {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:44:49 user nova-compute[75000]: INFO nova.compute.manager [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Attaching volume c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 to /dev/vdb
Nov 06 22:44:49 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG os_brick.utils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc71ae7-3a4c-4a9b-aa4d-6b54ebe69d89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e6f472-f965-4dcb-a0a9-c3b7fc6e9f66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af4df0d-d0ba-48a6-8178-4092481c8069]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92c40fd-fbe7-4e32-8f15-e5a46d60f6eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:44:49 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Deleted allocations for instance c1c40d17-3fb5-4b5d-9267-02cb7152ce3c
Nov 06 22:44:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:44:49 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d25453-1649-4b22-9996-4510ba385f96]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG os_brick.utils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Updating existing volume attachment record: 28e3a790-ff3a-46be-be54-e102ae1b2798 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:44:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0dcd5b6a-2104-4c5a-93b2-eac7b961e68c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "c1c40d17-3fb5-4b5d-9267-02cb7152ce3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.778s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:44:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:52 user nova-compute[75000]: INFO nova.compute.manager [None req-0aaa9944-7d5c-49e6-b98c-e469ff83c2e5 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Get console output
Nov 06 22:44:52 user nova-compute[75000]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 06 22:44:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:44:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JYVsvQFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:45:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:01 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7945ea3-fd4d-4413-aeef-0bdf1c06103d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:45:01 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b34598c-fe3a-4742-97a6-d15ed0182d80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb] added
Nov 06 22:45:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b4bbf2-6efc-42ed-a9a3-836b5f08a7b2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad5fc24-27a9-4669-b36d-f31e8a0df814]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JYVsvQFD {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JYVsvQFD" returned: 0 in 0.155s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ebd5e-33fe-4d7a-8787-8fa43ac0779c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JYVsvQFD'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec48d0d-a9da-4a17-a2b3-091b095a1129]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f5ba68-106b-49d1-94f0-545318d24ce7]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:01 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:45:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:01 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:45:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba52e4c-ab57-4e73-bc59-6ff68b67413d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb, portal: 172.16.0.220,3260]
Nov 06 22:45:01 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb, portal: 172.16.0.220,3260] successful.
Nov 06 22:45:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[719f6798-0960-4f66-bf96-2f1877240736]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5417525e-d2da-4db5-a465-7aa95aeed597]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:01 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:01 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:45:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:01 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:01 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:45:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ceb424-3d50-45cd-8268-df66b9e4f5aa]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:45:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:45:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JYVsvQFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:45:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23463353363366566', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:45:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463353363366566', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:45:02 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:45:02 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:45:02 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:45:02 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:45:02 user nova-compute[75000]:   <serial>18aa7838-94b0-4cb4-9c5a-483aef8dbacb</serial>
Nov 06 22:45:02 user nova-compute[75000]: </disk>
Nov 06 22:45:02 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:45:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:45:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:45:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] No VIF found with MAC fa:16:3e:a2:a0:8b, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:45:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c084ee8d-d84e-4b9c-af2b-72ef0a6e853c tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.577s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:05 user nova-compute[75000]: INFO nova.compute.manager [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Detaching volume 18aa7838-94b0-4cb4-9c5a-483aef8dbacb
Nov 06 22:45:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:05 user nova-compute[75000]: INFO nova.virt.block_device [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Attempting to driver detach volume 18aa7838-94b0-4cb4-9c5a-483aef8dbacb from mountpoint /dev/vdb
Nov 06 22:45:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Attempting to detach device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:45:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:45:05 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:45:05 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:45:05 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:45:05 user nova-compute[75000]:   <serial>18aa7838-94b0-4cb4-9c5a-483aef8dbacb</serial>
Nov 06 22:45:05 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:45:05 user nova-compute[75000]: </disk>
Nov 06 22:45:05 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:45:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully detached device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the persistent domain config.
Nov 06 22:45:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:45:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:45:05 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:45:05 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:45:05 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:45:05 user nova-compute[75000]:   <serial>18aa7838-94b0-4cb4-9c5a-483aef8dbacb</serial>
Nov 06 22:45:05 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:45:05 user nova-compute[75000]: </disk>
Nov 06 22:45:05 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:45:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:45:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:09 user nova-compute[75000]: INFO nova.compute.manager [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Terminating instance
Nov 06 22:45:09 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-cd94738b-508e-4143-b4e7-22598ce295d4 req-8cdcdee2-0461-4bf8-ac3a-4d5394fef7bb service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-unplugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cd94738b-508e-4143-b4e7-22598ce295d4 req-8cdcdee2-0461-4bf8-ac3a-4d5394fef7bb service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cd94738b-508e-4143-b4e7-22598ce295d4 req-8cdcdee2-0461-4bf8-ac3a-4d5394fef7bb service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cd94738b-508e-4143-b4e7-22598ce295d4 req-8cdcdee2-0461-4bf8-ac3a-4d5394fef7bb service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-cd94738b-508e-4143-b4e7-22598ce295d4 req-8cdcdee2-0461-4bf8-ac3a-4d5394fef7bb service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-unplugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-cd94738b-508e-4143-b4e7-22598ce295d4 req-8cdcdee2-0461-4bf8-ac3a-4d5394fef7bb service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-unplugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Instance destroyed successfully.
Nov 06 22:45:10 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'resources' on Instance uuid d3e6809f-acbd-4763-8d7e-6e748aeab307 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-487460800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-487460800',id=13,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-yuq7rxnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:32:19Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=d3e6809f-acbd-4763-8d7e-6e748aeab307,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "address": "fa:16:3e:a7:7b:51", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc5619-ee", "ovs_interfaceid": "04dc5619-eedb-4e04-8f38-cb414d77eb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7b:51,bridge_name='br-int',has_traffic_filtering=True,id=04dc5619-eedb-4e04-8f38-cb414d77eb54,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc5619-ee') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_vif [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7b:51,bridge_name='br-int',has_traffic_filtering=True,id=04dc5619-eedb-4e04-8f38-cb414d77eb54,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc5619-ee') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04dc5619-ee, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63992f0c-271a-4e1d-a285-375277b98726) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:10 user nova-compute[75000]: INFO os_vif [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7b:51,bridge_name='br-int',has_traffic_filtering=True,id=04dc5619-eedb-4e04-8f38-cb414d77eb54,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04dc5619-ee')
Nov 06 22:45:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNHpGySu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:45:10 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b978808-9010-4a43-9739-edcecca9616c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:45:10 user nova-compute[75000]: No targets found.
Nov 06 22:45:10 user nova-compute[75000]: iSNS:
Nov 06 22:45:10 user nova-compute[75000]: No targets found.
Nov 06 22:45:10 user nova-compute[75000]: STATIC:
Nov 06 22:45:10 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200
Nov 06 22:45:10 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:10 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:10 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:45:10 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:10 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:10 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb
Nov 06 22:45:10 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:10 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:10 user nova-compute[75000]: FIRMWARE:
Nov 06 22:45:10 user nova-compute[75000]: No targets found.
Nov 06 22:45:10 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:45:10 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:45:10 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[791d8695-4382-4b00-a67b-620931479c26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eeff1f-878f-4ef2-979e-1d670453762c]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:10 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:10 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:45:10 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:10 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:10 user nova-compute[75000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 (non-flash)
Nov 06 22:45:10 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc1109d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[27414d42-4697-4fb1-b3bb-568a2531485a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dd64cc-ccf3-41f3-b732-5ce1d02d9a88]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:45:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[78586781-95c8-47b3-88ce-e3b6b3830d68]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f20fd06-bfa8-47c2-bdf4-d36f910d5c02]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[529134c7-521b-4160-b1c6-656c0059dbaa]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50bd6d0-37bd-4d93-bff9-b5a4fc827165]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200, portal: 172.16.0.220,3260]
Nov 06 22:45:11 user nova-compute[75000]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200, portal: 172.16.0.220,3260] successful.
Nov 06 22:45:11 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20156e99-9d0d-4fd7-8b1f-78eb97a74200 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8629a4f1-62d5-4525-aec8-022eacc90384]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] <== disconnect_volume: return (309ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:45:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Deleting instance files /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307_del
Nov 06 22:45:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Deletion of /opt/stack/data/nova/instances/d3e6809f-acbd-4763-8d7e-6e748aeab307_del complete
Nov 06 22:45:11 user nova-compute[75000]: INFO nova.compute.manager [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 06 22:45:11 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:45:11 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:45:11 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Took 0.73 seconds to deallocate network for instance.
Nov 06 22:45:11 user nova-compute[75000]: DEBUG nova.compute.manager [req-2b650151-44f3-4cfa-845c-9073c77fe1ad req-25183206-8998-495e-821b-efbd01fa0636 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-deleted-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:45:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-6edc9b40-e19d-4934-9484-9abbb732beff req-c0735a36-b724-45d8-9fd3-51f5190110a1 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:45:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6edc9b40-e19d-4934-9484-9abbb732beff req-c0735a36-b724-45d8-9fd3-51f5190110a1 service nova] Acquiring lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6edc9b40-e19d-4934-9484-9abbb732beff req-c0735a36-b724-45d8-9fd3-51f5190110a1 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6edc9b40-e19d-4934-9484-9abbb732beff req-c0735a36-b724-45d8-9fd3-51f5190110a1 service nova] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-6edc9b40-e19d-4934-9484-9abbb732beff req-c0735a36-b724-45d8-9fd3-51f5190110a1 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] No waiting events found dispatching network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:45:12 user nova-compute[75000]: WARNING nova.compute.manager [req-6edc9b40-e19d-4934-9484-9abbb732beff req-c0735a36-b724-45d8-9fd3-51f5190110a1 service nova] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Received unexpected event network-vif-plugged-04dc5619-eedb-4e04-8f38-cb414d77eb54 for instance with vm_state active and task_state deleting.
Nov 06 22:45:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrfxBIVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:45:13 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:13 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:13 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f4f46c-1b3f-4b39-ab66-371957c253c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:45:13 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f9c489-f0f0-40c2-88e4-1f5ad3c2c7cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87] added
Nov 06 22:45:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a8102d-d9cb-4138-9d2c-397232eb9343]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[443a63d0-7057-46bf-ac0d-35086010207e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yrfxBIVP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yrfxBIVP" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6edca52-a0cd-40cd-9502-ecc98d702119]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yrfxBIVP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c09b5-29fb-48ca-bfcc-339189586121]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[339d6ba2-fded-468a-8558-806530cf6c18]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:13 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:13 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf2abef-3061-4a92-9c94-4a056efdaba2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87, portal: 172.16.0.220,3260]
Nov 06 22:45:13 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87, portal: 172.16.0.220,3260] successful.
Nov 06 22:45:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b5f94c-8715-4d3b-8718-b1269b38e539]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c62a20-78a1-4bd8-a8b1-80cd6cebf469]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:13 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:13 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:13 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:13 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a487ea-27ed-4413-94d4-cbb505c82c9a]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:13 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:45:14 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:45:14 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrfxBIVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:45:14 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:14 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26266336662653063', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:45:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266336662653063', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:45:14 user nova-compute[75000]: DEBUG nova.objects.instance [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'flavor' on Instance uuid 72e24734-35e3-4e5c-9f8a-85d14397387d {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:45:14 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:45:14 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 22:45:14 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:45:14 user nova-compute[75000]:   <serial>c6eadf1c-cbcb-447a-b6ab-39af9fef6c87</serial>
Nov 06 22:45:14 user nova-compute[75000]: </disk>
Nov 06 22:45:14 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:45:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:45:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:45:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No VIF found with MAC fa:16:3e:21:4a:93, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:45:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-94f28737-7e69-4bbd-850c-f30914d44b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.029s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:16 user nova-compute[75000]: INFO nova.compute.manager [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Detaching volume c6eadf1c-cbcb-447a-b6ab-39af9fef6c87
Nov 06 22:45:16 user nova-compute[75000]: INFO nova.virt.block_device [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Attempting to driver detach volume c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 from mountpoint /dev/vdb
Nov 06 22:45:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Attempting to detach device vdb from instance 72e24734-35e3-4e5c-9f8a-85d14397387d from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:45:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:45:16 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:45:16 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 22:45:16 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:45:16 user nova-compute[75000]:   <serial>c6eadf1c-cbcb-447a-b6ab-39af9fef6c87</serial>
Nov 06 22:45:16 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:45:16 user nova-compute[75000]: </disk>
Nov 06 22:45:16 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:45:16 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully detached device vdb from instance 72e24734-35e3-4e5c-9f8a-85d14397387d from the persistent domain config.
Nov 06 22:45:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72e24734-35e3-4e5c-9f8a-85d14397387d from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:45:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:45:16 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:45:16 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 22:45:16 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:45:16 user nova-compute[75000]:   <serial>c6eadf1c-cbcb-447a-b6ab-39af9fef6c87</serial>
Nov 06 22:45:16 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:45:16 user nova-compute[75000]: </disk>
Nov 06 22:45:16 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:45:16 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72e24734-35e3-4e5c-9f8a-85d14397387d {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:45:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:45:25 user nova-compute[75000]: INFO nova.compute.manager [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: d3e6809f-acbd-4763-8d7e-6e748aeab307] Took 13.12 seconds to detach 1 volumes for instance.
Nov 06 22:45:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.160s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'pci_requests' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'numa_topology' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:25 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Deleted allocations for instance d3e6809f-acbd-4763-8d7e-6e748aeab307
Nov 06 22:45:25 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:45:25 user nova-compute[75000]: INFO nova.compute.claims [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Claim successful on node user
Nov 06 22:45:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a328fc36-5e4c-40ba-913f-53b42b13e4a0 tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "d3e6809f-acbd-4763-8d7e-6e748aeab307" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.615s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:45:25 user nova-compute[75000]: INFO nova.network.neutron [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updating port 035045a6-0a9c-4787-8776-876c1cb58343 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 22:45:26 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb is timed out.
Nov 06 22:45:26 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully detached device vdb from instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb from the live domain config.
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JYVsvQFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:45:26 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2c0a04-f7d6-4100-9a68-871fa528ea8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:45:26 user nova-compute[75000]: No targets found.
Nov 06 22:45:26 user nova-compute[75000]: iSNS:
Nov 06 22:45:26 user nova-compute[75000]: No targets found.
Nov 06 22:45:26 user nova-compute[75000]: STATIC:
Nov 06 22:45:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87
Nov 06 22:45:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:45:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:26 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb
Nov 06 22:45:26 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:26 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:26 user nova-compute[75000]: FIRMWARE:
Nov 06 22:45:26 user nova-compute[75000]: No targets found.
Nov 06 22:45:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:45:26 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:45:26 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da48e365-00eb-4c17-9a17-4a2475fff831]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11f6da4-3b00-45f3-9310-0937bc8d467f]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:26 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:26 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:26 user nova-compute[75000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb (non-flash)
Nov 06 22:45:26 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b8fc97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquired lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef922f83-0888-445f-aed3-2defe5d59d4d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-e18d672f-9b53-4193-a083-642b8d3da910 req-4ad0cb16-a562-4b2a-b671-1b737bd50376 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-changed-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-e18d672f-9b53-4193-a083-642b8d3da910 req-4ad0cb16-a562-4b2a-b671-1b737bd50376 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Refreshing instance network info cache due to event network-changed-035045a6-0a9c-4787-8776-876c1cb58343. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e18d672f-9b53-4193-a083-642b8d3da910 req-4ad0cb16-a562-4b2a-b671-1b737bd50376 service nova] Acquiring lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a13376-1349-4b9b-999a-4f508f7c0828]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba412941-7462-44c0-8de6-e212ff717c1a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6564332-3d73-4813-b9b5-71674b33f964]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a661983-9833-4251-8e55-b962af088ef6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eee58a3-5a14-459e-bac4-3d47c31f0fb7]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb, portal: 172.16.0.220,3260]
Nov 06 22:45:26 user nova-compute[75000]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb, portal: 172.16.0.220,3260] successful.
Nov 06 22:45:26 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18aa7838-94b0-4cb4-9c5a-483aef8dbacb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c878f2-d42f-4c38-8051-720b48e1a819]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] <== disconnect_volume: return (322ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updating instance_info_cache with network_info: [{"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Releasing lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:45:26 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Creating image(s)
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'trusted_certs' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e18d672f-9b53-4193-a083-642b8d3da910 req-4ad0cb16-a562-4b2a-b671-1b737bd50376 service nova] Acquired lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.network.neutron [req-e18d672f-9b53-4193-a083-642b8d3da910 req-4ad0cb16-a562-4b2a-b671-1b737bd50376 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Refreshing network info cache for port 035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG nova.objects.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<f31ab346-0c23-4086-9c16-3322dc972c5f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "7910019615a65df34ddbe9e1706a14e2182451a5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "7910019615a65df34ddbe9e1706a14e2182451a5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG nova.objects.instance [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'flavor' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f46dcf34-df5c-49cb-b415-6e65ba621cdb tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.458s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG nova.virt.images [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] 8a2cf4d7-17cb-4498-b8eb-555b273bec10 was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5.part /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG nova.network.neutron [req-e18d672f-9b53-4193-a083-642b8d3da910 req-4ad0cb16-a562-4b2a-b671-1b737bd50376 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updated VIF entry in instance network info cache for port 035045a6-0a9c-4787-8776-876c1cb58343. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG nova.network.neutron [req-e18d672f-9b53-4193-a083-642b8d3da910 req-4ad0cb16-a562-4b2a-b671-1b737bd50376 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updating instance_info_cache with network_info: [{"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e18d672f-9b53-4193-a083-642b8d3da910 req-4ad0cb16-a562-4b2a-b671-1b737bd50376 service nova] Releasing lock "refresh_cache-f31ab346-0c23-4086-9c16-3322dc972c5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5.part /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5.converted" returned: 0 in 0.327s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "7910019615a65df34ddbe9e1706a14e2182451a5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.895s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5 --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "7910019615a65df34ddbe9e1706a14e2182451a5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "7910019615a65df34ddbe9e1706a14e2182451a5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5 --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5,backing_fmt=raw /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5,backing_fmt=raw /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk 1073741824" returned: 0 in 0.051s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "7910019615a65df34ddbe9e1706a14e2182451a5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5 --force-share --output=json" returned: 0 in 0.169s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'migration_context' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG nova.objects.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<f31ab346-0c23-4086-9c16-3322dc972c5f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:45:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Rebasing disk image.
Nov 06 22:45:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 -F raw /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 -F raw /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk" returned: 0 in 2.510s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Ensure instance console log exists: /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Start _get_guest_xml network_info=[{"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='8c73ddbfc4a42b7124f0b48c53a594e2',container_format='bare',created_at=2023-11-06T22:42:53Z,direct_url=<?>,disk_format='qcow2',id=8a2cf4d7-17cb-4498-b8eb-555b273bec10,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746831654-shelved',owner='e9412d5020f342499289d8ad48e19ac4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T22:42:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmyCMAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f31ab346-0c23-4086-9c16-3322dc972c5f', 'attached_at': '', 'detached_at': '', 'volume_id': '2d15d74e-17fa-4d73-9445-4a19e172499e', 'serial': '2d15d74e-17fa-4d73-9445-4a19e172499e'}, 'attachment_id': '729256a0-e959-448a-baa2-826baa992f7e', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:45:32 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:45:32 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8c73ddbfc4a42b7124f0b48c53a594e2',container_format='bare',created_at=2023-11-06T22:42:53Z,direct_url=<?>,disk_format='qcow2',id=8a2cf4d7-17cb-4498-b8eb-555b273bec10,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746831654-shelved',owner='e9412d5020f342499289d8ad48e19ac4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T22:42:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'vcpu_model' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.objects.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<f31ab346-0c23-4086-9c16-3322dc972c5f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmyCMAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:45:32 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:32 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:32 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39c3192-a349-477f-af1d-a490b62f95b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:45:32 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0633468-d5f1-4000-ba3a-ae84b41c8644]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e] added
Nov 06 22:45:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6242b05-ef54-4e4d-8fbd-0eaa2f31051f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8ec08f-cfed-453f-a0c2-e603f3e30eb9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFmyCMAq {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFmyCMAq" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca2bf25-20ab-4c07-906b-40521c9246a2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nFmyCMAq'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dcccca-216d-4992-af7a-c78fd0363dc7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e026bb-ee78-4cab-8f9d-096a8c38eba8]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:32 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:32 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b950ad9-cb09-488d-9970-e0d7489e9b64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e, portal: 172.16.0.220,3260]
Nov 06 22:45:32 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e, portal: 172.16.0.220,3260] successful.
Nov 06 22:45:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca291a01-d47b-48ab-9fd8-cb139afd3b83]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc07e959-8bd6-46fc-8a09-4f06d2be0484]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:32 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:32 user nova-compute[75000]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:45:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:32 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:32 user nova-compute[75000]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:45:32 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b38fe9-d124-4efa-8318-2143460a2009]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:32 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmyCMAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26465303034666533', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465303034666533', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746831654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746831654',id=33,image_ref='8a2cf4d7-17cb-4498-b8eb-555b273bec10',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1457495529',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-06levmq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member',shelved_at='2023-11-06T22:42:59.029053',shelved_host='user',shelved_image_id='8a2cf4d7-17cb-4498-b8eb-555b273bec10'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:44:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=f31ab346-0c23-4086-9c16-3322dc972c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'pci_devices' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.objects.base [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<f31ab346-0c23-4086-9c16-3322dc972c5f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:45:33 user nova-compute[75000]:   <uuid>f31ab346-0c23-4086-9c16-3322dc972c5f</uuid>
Nov 06 22:45:33 user nova-compute[75000]:   <name>instance-00000021</name>
Nov 06 22:45:33 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:45:33 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:45:33 user nova-compute[75000]:   <metadata>
Nov 06 22:45:33 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:45:33 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:45:33 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746831654</nova:name>
Nov 06 22:45:33 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:45:32</nova:creationTime>
Nov 06 22:45:33 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:45:33 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:45:33 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:45:33 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:45:33 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:45:33 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:45:33 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:45:33 user nova-compute[75000]:       <nova:owner>
Nov 06 22:45:33 user nova-compute[75000]:         <nova:user uuid="27639ab7ae064eca9e2c1b23ded8a866">tempest-AttachVolumeShelveTestJSON-346837560-project-member</nova:user>
Nov 06 22:45:33 user nova-compute[75000]:         <nova:project uuid="e9412d5020f342499289d8ad48e19ac4">tempest-AttachVolumeShelveTestJSON-346837560</nova:project>
Nov 06 22:45:33 user nova-compute[75000]:       </nova:owner>
Nov 06 22:45:33 user nova-compute[75000]:       <nova:root type="image" uuid="8a2cf4d7-17cb-4498-b8eb-555b273bec10"/>
Nov 06 22:45:33 user nova-compute[75000]:       <nova:ports>
Nov 06 22:45:33 user nova-compute[75000]:         <nova:port uuid="035045a6-0a9c-4787-8776-876c1cb58343">
Nov 06 22:45:33 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 22:45:33 user nova-compute[75000]:         </nova:port>
Nov 06 22:45:33 user nova-compute[75000]:       </nova:ports>
Nov 06 22:45:33 user nova-compute[75000]:     </nova:instance>
Nov 06 22:45:33 user nova-compute[75000]:   </metadata>
Nov 06 22:45:33 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:45:33 user nova-compute[75000]:     <system>
Nov 06 22:45:33 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:45:33 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:45:33 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:45:33 user nova-compute[75000]:       <entry name="serial">f31ab346-0c23-4086-9c16-3322dc972c5f</entry>
Nov 06 22:45:33 user nova-compute[75000]:       <entry name="uuid">f31ab346-0c23-4086-9c16-3322dc972c5f</entry>
Nov 06 22:45:33 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:45:33 user nova-compute[75000]:     </system>
Nov 06 22:45:33 user nova-compute[75000]:   </sysinfo>
Nov 06 22:45:33 user nova-compute[75000]:   <os>
Nov 06 22:45:33 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:45:33 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:45:33 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:45:33 user nova-compute[75000]:   </os>
Nov 06 22:45:33 user nova-compute[75000]:   <features>
Nov 06 22:45:33 user nova-compute[75000]:     <acpi/>
Nov 06 22:45:33 user nova-compute[75000]:     <apic/>
Nov 06 22:45:33 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:45:33 user nova-compute[75000]:   </features>
Nov 06 22:45:33 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:45:33 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:45:33 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:45:33 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:45:33 user nova-compute[75000]:   </clock>
Nov 06 22:45:33 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:45:33 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:45:33 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:45:33 user nova-compute[75000]:   </cpu>
Nov 06 22:45:33 user nova-compute[75000]:   <devices>
Nov 06 22:45:33 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:45:33 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:45:33 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk"/>
Nov 06 22:45:33 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:45:33 user nova-compute[75000]:     </disk>
Nov 06 22:45:33 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:45:33 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:45:33 user nova-compute[75000]:       <source dev="/dev/sdc"/>
Nov 06 22:45:33 user nova-compute[75000]:       <target dev="vdc" bus="virtio"/>
Nov 06 22:45:33 user nova-compute[75000]:       <serial>2d15d74e-17fa-4d73-9445-4a19e172499e</serial>
Nov 06 22:45:33 user nova-compute[75000]:     </disk>
Nov 06 22:45:33 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:45:33 user nova-compute[75000]:       <mac address="fa:16:3e:05:5e:74"/>
Nov 06 22:45:33 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:45:33 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:45:33 user nova-compute[75000]:       <target dev="tap035045a6-0a"/>
Nov 06 22:45:33 user nova-compute[75000]:     </interface>
Nov 06 22:45:33 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:45:33 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/console.log" append="off"/>
Nov 06 22:45:33 user nova-compute[75000]:     </serial>
Nov 06 22:45:33 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:45:33 user nova-compute[75000]:     <video>
Nov 06 22:45:33 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:45:33 user nova-compute[75000]:     </video>
Nov 06 22:45:33 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:45:33 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:45:33 user nova-compute[75000]:     </rng>
Nov 06 22:45:33 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:45:33 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:45:33 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:45:33 user nova-compute[75000]:     </memballoon>
Nov 06 22:45:33 user nova-compute[75000]:   </devices>
Nov 06 22:45:33 user nova-compute[75000]: </domain>
Nov 06 22:45:33 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746831654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746831654',id=33,image_ref='8a2cf4d7-17cb-4498-b8eb-555b273bec10',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1457495529',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:41:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-06levmq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member',shelved_at='2023-11-06T22:42:59.029053',shelved_host='user',shelved_image_id='8a2cf4d7-17cb-4498-b8eb-555b273bec10'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:44:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=f31ab346-0c23-4086-9c16-3322dc972c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG os_vif [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62c9c169-6fde-5731-a1c0-6dbde98b5bf9', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap035045a6-0a, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap035045a6-0a, col_values=(('qos', UUID('3505b0ba-12f7-41a2-bdcb-7f5189254a8d')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap035045a6-0a, col_values=(('external_ids', {'iface-id': '035045a6-0a9c-4787-8776-876c1cb58343', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:5e:74', 'vm-uuid': 'f31ab346-0c23-4086-9c16-3322dc972c5f'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:33 user nova-compute[75000]: INFO os_vif [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a')
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:45:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] No VIF found with MAC fa:16:3e:05:5e:74, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:45:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-05f2cee6-b1ac-4d2c-b0c9-daedda24e921 req-4f31cc6f-459d-4406-9b28-6b5822883164 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:45:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-05f2cee6-b1ac-4d2c-b0c9-daedda24e921 req-4f31cc6f-459d-4406-9b28-6b5822883164 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-05f2cee6-b1ac-4d2c-b0c9-daedda24e921 req-4f31cc6f-459d-4406-9b28-6b5822883164 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-05f2cee6-b1ac-4d2c-b0c9-daedda24e921 req-4f31cc6f-459d-4406-9b28-6b5822883164 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-05f2cee6-b1ac-4d2c-b0c9-daedda24e921 req-4f31cc6f-459d-4406-9b28-6b5822883164 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:45:35 user nova-compute[75000]: WARNING nova.compute.manager [req-05f2cee6-b1ac-4d2c-b0c9-daedda24e921 req-4f31cc6f-459d-4406-9b28-6b5822883164 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 22:45:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:36 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72e24734-35e3-4e5c-9f8a-85d14397387d is timed out.
Nov 06 22:45:36 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully detached device vdb from instance 72e24734-35e3-4e5c-9f8a-85d14397387d from the live domain config.
Nov 06 22:45:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrfxBIVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:45:36 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd0eab-9e33-4140-a5b7-37273f23addd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:45:36 user nova-compute[75000]: No targets found.
Nov 06 22:45:36 user nova-compute[75000]: iSNS:
Nov 06 22:45:36 user nova-compute[75000]: No targets found.
Nov 06 22:45:36 user nova-compute[75000]: STATIC:
Nov 06 22:45:36 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87
Nov 06 22:45:36 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:36 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:36 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:45:36 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:36 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:36 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e
Nov 06 22:45:36 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:36 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:36 user nova-compute[75000]: FIRMWARE:
Nov 06 22:45:36 user nova-compute[75000]: No targets found.
Nov 06 22:45:36 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:45:36 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:45:36 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[91000863-600b-4911-b648-5588a36b810f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32fcb47-a8ad-4765-acbd-ee5c053437d2]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:36 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:36 user nova-compute[75000]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:45:36 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:36 user nova-compute[75000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 (non-flash)
Nov 06 22:45:36 user nova-compute[75000]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:45:36 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc1132e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36d63a7-6a14-4750-b48d-99d7e0740280]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c877ab-ed88-4b25-b2d5-b9480e51b2b4]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9df4dc4-f3fb-4f71-a87e-aa4390d79f88]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdb26b2-8bf9-4aac-b749-332087ace16c]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[54372a17-6e2c-4b3f-b5a6-95bafe0857d5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b3ed37-9783-488f-8c74-4ea308498f89]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87, portal: 172.16.0.220,3260]
Nov 06 22:45:36 user nova-compute[75000]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87, portal: 172.16.0.220,3260] successful.
Nov 06 22:45:36 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6eadf1c-cbcb-447a-b6ab-39af9fef6c87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[942312b5-0c27-425f-86b6-367d002af9d5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] <== disconnect_volume: return (317ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:45:37 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance spawned successfully.
Nov 06 22:45:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-a5ad26c7-dfc6-4b5a-a8c5-b0e9da488b3e req-858708b3-0d7b-4cea-8447-82c0b068ea53 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a5ad26c7-dfc6-4b5a-a8c5-b0e9da488b3e req-858708b3-0d7b-4cea-8447-82c0b068ea53 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a5ad26c7-dfc6-4b5a-a8c5-b0e9da488b3e req-858708b3-0d7b-4cea-8447-82c0b068ea53 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a5ad26c7-dfc6-4b5a-a8c5-b0e9da488b3e req-858708b3-0d7b-4cea-8447-82c0b068ea53 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-a5ad26c7-dfc6-4b5a-a8c5-b0e9da488b3e req-858708b3-0d7b-4cea-8447-82c0b068ea53 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:45:37 user nova-compute[75000]: WARNING nova.compute.manager [req-a5ad26c7-dfc6-4b5a-a8c5-b0e9da488b3e req-858708b3-0d7b-4cea-8447-82c0b068ea53 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 22:45:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4462224e-6d52-4fbe-b0eb-81fca097e607 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 51.843s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:37 user nova-compute[75000]: DEBUG nova.objects.instance [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'flavor' on Instance uuid 72e24734-35e3-4e5c-9f8a-85d14397387d {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-48d8dd87-5728-4579-a165-218a2b6111d6 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.903s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating instance_info_cache with network_info: [{"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:45:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:45:42 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:45:42 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=25.000511169433594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance bf3bafdf-dba5-4961-a891-98f522b27f53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 72e24734-35e3-4e5c-9f8a-85d14397387d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance df39e1c2-a3f5-4133-a101-4a7320987e72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f31ab346-0c23-4086-9c16-3322dc972c5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:45:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:45:43 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:45:43 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:45:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:45:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:44 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:45:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:45:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:45:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:45:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:45:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:53 user nova-compute[75000]: INFO nova.compute.manager [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Terminating instance
Nov 06 22:45:53 user nova-compute[75000]: DEBUG nova.compute.manager [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-a570f1fe-c85a-40b0-a2d3-400d725262b1 req-c082db64-9e34-49e6-b1bc-da96230d41ec service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-unplugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a570f1fe-c85a-40b0-a2d3-400d725262b1 req-c082db64-9e34-49e6-b1bc-da96230d41ec service nova] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a570f1fe-c85a-40b0-a2d3-400d725262b1 req-c082db64-9e34-49e6-b1bc-da96230d41ec service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a570f1fe-c85a-40b0-a2d3-400d725262b1 req-c082db64-9e34-49e6-b1bc-da96230d41ec service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-a570f1fe-c85a-40b0-a2d3-400d725262b1 req-c082db64-9e34-49e6-b1bc-da96230d41ec service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] No waiting events found dispatching network-vif-unplugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-a570f1fe-c85a-40b0-a2d3-400d725262b1 req-c082db64-9e34-49e6-b1bc-da96230d41ec service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-unplugged-813e48da-0008-4864-9dbd-002434796b1a for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:45:54 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Instance destroyed successfully.
Nov 06 22:45:54 user nova-compute[75000]: DEBUG nova.objects.instance [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'resources' on Instance uuid 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1148922530',display_name='tempest-ServerActionsTestOtherA-server-1148922530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1148922530',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWWSt8DqD1UiX7y0P2zcc1XaSgfLqWPMHCsT4qhuCpJN/KYahOdMyvjBaIfA8wTAtF3OG7T0GjKSjZNjN+adINTC3kMpTN5nU53yfK9kl9yrZK3oIAKJYF1R8Z+Truelg==',key_name='tempest-keypair-832438895',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-g4bey4gp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=2ea4dcf9-775b-4f7c-8cac-0a325a74dc65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "813e48da-0008-4864-9dbd-002434796b1a", "address": "fa:16:3e:61:00:b1", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813e48da-00", "ovs_interfaceid": "813e48da-0008-4864-9dbd-002434796b1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_vif [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap813e48da-00, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4db1c550-796c-4ab3-86b9-fd095db51d1e) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:45:54 user nova-compute[75000]: INFO os_vif [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:00:b1,bridge_name='br-int',has_traffic_filtering=True,id=813e48da-0008-4864-9dbd-002434796b1a,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813e48da-00')
Nov 06 22:45:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'peNCnhEY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:45:54 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc3bab-722c-453d-82eb-afa8509023c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:45:54 user nova-compute[75000]: No targets found.
Nov 06 22:45:54 user nova-compute[75000]: iSNS:
Nov 06 22:45:54 user nova-compute[75000]: No targets found.
Nov 06 22:45:54 user nova-compute[75000]: STATIC:
Nov 06 22:45:54 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519
Nov 06 22:45:54 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:54 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:54 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e
Nov 06 22:45:54 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:45:54 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:45:54 user nova-compute[75000]: FIRMWARE:
Nov 06 22:45:54 user nova-compute[75000]: No targets found.
Nov 06 22:45:54 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:45:54 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:45:54 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e63dc97-cde1-4865-a54c-67e3285d96b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc455ef-5d92-43f5-a941-9e25435f7a80]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:54 user nova-compute[75000]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:45:54 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 (non-flash)
Nov 06 22:45:54 user nova-compute[75000]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:45:54 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc110ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519'): ({'sdd'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Removing single pathed devices sdd {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc715a-f6b4-4910-9d5c-3d1c6d633b87]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0357b6de-9bc3-4f30-9038-d9da6c42cd29]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Flushing IO for device /dev/sdd {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9941bcfc-3ed9-4b70-8d90-a2c36683bc67]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c500d4-2a61-4453-9c42-a34b5d06b2f6]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26562396364323933', '/dev/disk/by-id/scsi-1SCST_BIO78c2e2ae-eb9cd293b2ddd11e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_78c2e2ae') {{(pid=86571) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9dc646-5137-4649-bc6b-466753898bff]: (4, None) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ee7e4a-4b23-4c3d-8a41-92b1752f35b3]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[941a70a9-e350-4e66-8f83-a7005c1fa326]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260]
Nov 06 22:45:54 user nova-compute[75000]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519, portal: 172.16.0.220,3260] successful.
Nov 06 22:45:54 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b70ccb-55fe-46e6-8782-6913c98e0519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70770f0-ddac-4616-8897-e4099fb82376]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] <== disconnect_volume: return (311ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:45:54 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Deleting instance files /opt/stack/data/nova/instances/2ea4dcf9-775b-4f7c-8cac-0a325a74dc65_del
Nov 06 22:45:54 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Deletion of /opt/stack/data/nova/instances/2ea4dcf9-775b-4f7c-8cac-0a325a74dc65_del complete
Nov 06 22:45:54 user nova-compute[75000]: INFO nova.compute.manager [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 06 22:45:54 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:45:54 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:45:55 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:45:55 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Took 0.63 seconds to deallocate network for instance.
Nov 06 22:45:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:45:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-1bedb6d7-e1e9-4ab5-a24c-30c9d19f5afb req-ea0e7743-57bd-4fc8-8a21-0982f355c314 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:45:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1bedb6d7-e1e9-4ab5-a24c-30c9d19f5afb req-ea0e7743-57bd-4fc8-8a21-0982f355c314 service nova] Acquiring lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1bedb6d7-e1e9-4ab5-a24c-30c9d19f5afb req-ea0e7743-57bd-4fc8-8a21-0982f355c314 service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1bedb6d7-e1e9-4ab5-a24c-30c9d19f5afb req-ea0e7743-57bd-4fc8-8a21-0982f355c314 service nova] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-1bedb6d7-e1e9-4ab5-a24c-30c9d19f5afb req-ea0e7743-57bd-4fc8-8a21-0982f355c314 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] No waiting events found dispatching network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:45:55 user nova-compute[75000]: WARNING nova.compute.manager [req-1bedb6d7-e1e9-4ab5-a24c-30c9d19f5afb req-ea0e7743-57bd-4fc8-8a21-0982f355c314 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received unexpected event network-vif-plugged-813e48da-0008-4864-9dbd-002434796b1a for instance with vm_state active and task_state deleting.
Nov 06 22:45:55 user nova-compute[75000]: DEBUG nova.compute.manager [req-1bedb6d7-e1e9-4ab5-a24c-30c9d19f5afb req-ea0e7743-57bd-4fc8-8a21-0982f355c314 service nova] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Received event network-vif-deleted-813e48da-0008-4864-9dbd-002434796b1a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:45:56 user nova-compute[75000]: INFO nova.compute.manager [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Took 0.89 seconds to detach 1 volumes for instance.
Nov 06 22:45:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65] Deleting volume: e3b70ccb-55fe-46e6-8782-6913c98e0519 {{(pid=75000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 22:45:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:45:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:45:56 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:45:56 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:45:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:56 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Deleted allocations for instance 2ea4dcf9-775b-4f7c-8cac-0a325a74dc65
Nov 06 22:45:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-450290c8-7058-4d3c-9e87-d463c52e0909 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "2ea4dcf9-775b-4f7c-8cac-0a325a74dc65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.487s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:45:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:00 user nova-compute[75000]: INFO nova.compute.manager [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Terminating instance
Nov 06 22:46:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-cd93fa72-fafa-47ba-b8c4-f590a8e4f05d req-9e774d46-9b47-45d3-b907-7b91f23ff0b5 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received event network-vif-unplugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cd93fa72-fafa-47ba-b8c4-f590a8e4f05d req-9e774d46-9b47-45d3-b907-7b91f23ff0b5 service nova] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cd93fa72-fafa-47ba-b8c4-f590a8e4f05d req-9e774d46-9b47-45d3-b907-7b91f23ff0b5 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cd93fa72-fafa-47ba-b8c4-f590a8e4f05d req-9e774d46-9b47-45d3-b907-7b91f23ff0b5 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-cd93fa72-fafa-47ba-b8c4-f590a8e4f05d req-9e774d46-9b47-45d3-b907-7b91f23ff0b5 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] No waiting events found dispatching network-vif-unplugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-cd93fa72-fafa-47ba-b8c4-f590a8e4f05d req-9e774d46-9b47-45d3-b907-7b91f23ff0b5 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received event network-vif-unplugged-af573ad3-e075-4cd4-83e1-d9fb02479076 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Instance destroyed successfully.
Nov 06 22:46:01 user nova-compute[75000]: DEBUG nova.objects.instance [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lazy-loading 'resources' on Instance uuid bf3bafdf-dba5-4961-a891-98f522b27f53 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1449310249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1449310249',id=1,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:25:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a7a8c838f784f309fb9f0066e3463ae',ramdisk_id='',reservation_id='r-p0wxclnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-294256413',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:27:28Z,user_data=None,user_id='ddbbf039233142eca9f4cdfe2396da7c',uuid=bf3bafdf-dba5-4961-a891-98f522b27f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converting VIF {"id": "af573ad3-e075-4cd4-83e1-d9fb02479076", "address": "fa:16:3e:d3:1e:11", "network": {"id": "363fdee7-05b4-4b15-898f-91f87fb889df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1900769182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a7a8c838f784f309fb9f0066e3463ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf573ad3-e0", "ovs_interfaceid": "af573ad3-e075-4cd4-83e1-d9fb02479076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:1e:11,bridge_name='br-int',has_traffic_filtering=True,id=af573ad3-e075-4cd4-83e1-d9fb02479076,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf573ad3-e0') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG os_vif [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:1e:11,bridge_name='br-int',has_traffic_filtering=True,id=af573ad3-e075-4cd4-83e1-d9fb02479076,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf573ad3-e0') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf573ad3-e0, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e1648d5-c555-47f4-9593-c7cf469d5a3b) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: INFO os_vif [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:1e:11,bridge_name='br-int',has_traffic_filtering=True,id=af573ad3-e075-4cd4-83e1-d9fb02479076,network=Network(363fdee7-05b4-4b15-898f-91f87fb889df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf573ad3-e0')
Nov 06 22:46:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Deleting instance files /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53_del
Nov 06 22:46:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Deletion of /opt/stack/data/nova/instances/bf3bafdf-dba5-4961-a891-98f522b27f53_del complete
Nov 06 22:46:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:01 user nova-compute[75000]: INFO nova.compute.manager [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 06 22:46:01 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:46:01 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:46:02 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Took 0.45 seconds to deallocate network for instance.
Nov 06 22:46:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-45c06aa0-445a-46d6-a010-d8ab3e0b642a req-b6cc50c8-4cb5-4661-af50-60ac4dd618f2 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received event network-vif-deleted-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-5159ab2f-5358-4daf-9e7b-e8897dfd01c8 req-b82e646a-691d-4b11-aa42-d7f21c2f1295 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received event network-changed-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-5159ab2f-5358-4daf-9e7b-e8897dfd01c8 req-b82e646a-691d-4b11-aa42-d7f21c2f1295 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Refreshing instance network info cache due to event network-changed-0ed826c4-2272-40f7-80a4-f8d4006cd042. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5159ab2f-5358-4daf-9e7b-e8897dfd01c8 req-b82e646a-691d-4b11-aa42-d7f21c2f1295 service nova] Acquiring lock "refresh_cache-df39e1c2-a3f5-4133-a101-4a7320987e72" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5159ab2f-5358-4daf-9e7b-e8897dfd01c8 req-b82e646a-691d-4b11-aa42-d7f21c2f1295 service nova] Acquired lock "refresh_cache-df39e1c2-a3f5-4133-a101-4a7320987e72" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-5159ab2f-5358-4daf-9e7b-e8897dfd01c8 req-b82e646a-691d-4b11-aa42-d7f21c2f1295 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Refreshing network info cache for port 0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:46:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:02 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Deleted allocations for instance bf3bafdf-dba5-4961-a891-98f522b27f53
Nov 06 22:46:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41b7ac88-6c50-405d-ba60-d74f04aa4b9e tempest-ServerBootFromVolumeStableRescueTest-294256413 tempest-ServerBootFromVolumeStableRescueTest-294256413-project-member] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.970s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG nova.network.neutron [req-5159ab2f-5358-4daf-9e7b-e8897dfd01c8 req-b82e646a-691d-4b11-aa42-d7f21c2f1295 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Updated VIF entry in instance network info cache for port 0ed826c4-2272-40f7-80a4-f8d4006cd042. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG nova.network.neutron [req-5159ab2f-5358-4daf-9e7b-e8897dfd01c8 req-b82e646a-691d-4b11-aa42-d7f21c2f1295 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Updating instance_info_cache with network_info: [{"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5159ab2f-5358-4daf-9e7b-e8897dfd01c8 req-b82e646a-691d-4b11-aa42-d7f21c2f1295 service nova] Releasing lock "refresh_cache-df39e1c2-a3f5-4133-a101-4a7320987e72" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] No waiting events found dispatching network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:03 user nova-compute[75000]: WARNING nova.compute.manager [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received unexpected event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 for instance with vm_state deleted and task_state None.
Nov 06 22:46:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] No waiting events found dispatching network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:03 user nova-compute[75000]: WARNING nova.compute.manager [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received unexpected event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 for instance with vm_state deleted and task_state None.
Nov 06 22:46:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] Acquiring lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] Lock "bf3bafdf-dba5-4961-a891-98f522b27f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] No waiting events found dispatching network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:03 user nova-compute[75000]: WARNING nova.compute.manager [req-2f8853aa-76a6-4102-9d23-13857c7ddd2b req-a70d9f64-b751-4e6c-82ca-b08666dfe762 service nova] [instance: bf3bafdf-dba5-4961-a891-98f522b27f53] Received unexpected event network-vif-plugged-af573ad3-e075-4cd4-83e1-d9fb02479076 for instance with vm_state deleted and task_state None.
Nov 06 22:46:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-a1042818-8481-4492-8ecd-67585e85443e req-51c41569-b409-4977-9f0a-578a0e2824e5 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received event network-changed-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-a1042818-8481-4492-8ecd-67585e85443e req-51c41569-b409-4977-9f0a-578a0e2824e5 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Refreshing instance network info cache due to event network-changed-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:46:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a1042818-8481-4492-8ecd-67585e85443e req-51c41569-b409-4977-9f0a-578a0e2824e5 service nova] Acquiring lock "refresh_cache-2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:46:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a1042818-8481-4492-8ecd-67585e85443e req-51c41569-b409-4977-9f0a-578a0e2824e5 service nova] Acquired lock "refresh_cache-2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:46:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-a1042818-8481-4492-8ecd-67585e85443e req-51c41569-b409-4977-9f0a-578a0e2824e5 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Refreshing network info cache for port e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:46:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:05 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'flavor' on Instance uuid 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:46:05 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Ignoring supplied device name: /dev/vdb
Nov 06 22:46:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-a1042818-8481-4492-8ecd-67585e85443e req-51c41569-b409-4977-9f0a-578a0e2824e5 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Updated VIF entry in instance network info cache for port e554e8e5-e5e6-4ff6-a487-b2f37fc616d3. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-a1042818-8481-4492-8ecd-67585e85443e req-51c41569-b409-4977-9f0a-578a0e2824e5 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Updating instance_info_cache with network_info: [{"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a1042818-8481-4492-8ecd-67585e85443e req-51c41569-b409-4977-9f0a-578a0e2824e5 service nova] Releasing lock "refresh_cache-2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:06 user nova-compute[75000]: INFO nova.compute.manager [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Attaching volume 45134703-54d2-40ed-8b34-8e59bcd4fd2c to /dev/vdb
Nov 06 22:46:06 user nova-compute[75000]: DEBUG os_brick.utils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99191b03-4407-4d2c-bcf4-ca7568228638]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf283f8-51e0-44e6-af1a-def218636d9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d58bd5e-892a-46d1-ac32-4b92b6d12d33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05031f4-da86-4492-a089-8e5e3f7f2fda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:46:06 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bb7f40-928d-4fc0-ae12-a59cb07fae7b]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG os_brick.utils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Updating existing volume attachment record: c510fe3a-07a3-45ff-b3f8-50306472bc32 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.006s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:06 user nova-compute[75000]: INFO nova.compute.manager [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Terminating instance
Nov 06 22:46:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-1a6095fc-c64f-4a61-bb03-5b00b467a982 req-f843b3b7-7f32-43c7-8004-dba7f678af26 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received event network-vif-unplugged-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1a6095fc-c64f-4a61-bb03-5b00b467a982 req-f843b3b7-7f32-43c7-8004-dba7f678af26 service nova] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1a6095fc-c64f-4a61-bb03-5b00b467a982 req-f843b3b7-7f32-43c7-8004-dba7f678af26 service nova] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1a6095fc-c64f-4a61-bb03-5b00b467a982 req-f843b3b7-7f32-43c7-8004-dba7f678af26 service nova] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-1a6095fc-c64f-4a61-bb03-5b00b467a982 req-f843b3b7-7f32-43c7-8004-dba7f678af26 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] No waiting events found dispatching network-vif-unplugged-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-1a6095fc-c64f-4a61-bb03-5b00b467a982 req-f843b3b7-7f32-43c7-8004-dba7f678af26 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received event network-vif-unplugged-a2cfad28-beca-4749-8335-a2a69ddcc677 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:46:07 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Instance destroyed successfully.
Nov 06 22:46:07 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'resources' on Instance uuid 72e24734-35e3-4e5c-9f8a-85d14397387d {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-664303252',display_name='tempest-AttachVolumeNegativeTest-server-664303252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-664303252',id=34,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGogN6tIEd6isNIYw39+qKM2NiVbZVLAURGMG1MvYZ/0ScSbRjDMm84+7qND/DszYyCg45h0otT/gOQcfGL3pEcKVGXPgPOqp3HkTaKSJCURkL6K+4IOOCrGH0XZ3/tA7g==',key_name='tempest-keypair-55703073',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:42:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-4puyx7jg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:42:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=72e24734-35e3-4e5c-9f8a-85d14397387d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "a2cfad28-beca-4749-8335-a2a69ddcc677", "address": "fa:16:3e:21:4a:93", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2cfad28-be", "ovs_interfaceid": "a2cfad28-beca-4749-8335-a2a69ddcc677", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:4a:93,bridge_name='br-int',has_traffic_filtering=True,id=a2cfad28-beca-4749-8335-a2a69ddcc677,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2cfad28-be') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG os_vif [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:4a:93,bridge_name='br-int',has_traffic_filtering=True,id=a2cfad28-beca-4749-8335-a2a69ddcc677,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2cfad28-be') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2cfad28-be, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f769d296-ce55-4fb2-a039-0c5f3b5853df) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:07 user nova-compute[75000]: INFO os_vif [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:4a:93,bridge_name='br-int',has_traffic_filtering=True,id=a2cfad28-beca-4749-8335-a2a69ddcc677,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2cfad28-be')
Nov 06 22:46:07 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Deleting instance files /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d_del
Nov 06 22:46:07 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Deletion of /opt/stack/data/nova/instances/72e24734-35e3-4e5c-9f8a-85d14397387d_del complete
Nov 06 22:46:07 user nova-compute[75000]: INFO nova.compute.manager [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 22:46:07 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:46:07 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:46:08 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:46:08 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Took 1.15 seconds to deallocate network for instance.
Nov 06 22:46:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-3a132f71-276b-4d08-8c3c-75751158a884 req-2953074e-33b1-4d14-8f09-5f397dcff651 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received event network-vif-deleted-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:09 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:46:09 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:46:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-4db2ed96-0cfc-43f6-ac13-1c2c9684aeda req-6e19cabe-2d30-40fe-bd2c-3c0d268b16c0 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received event network-vif-plugged-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4db2ed96-0cfc-43f6-ac13-1c2c9684aeda req-6e19cabe-2d30-40fe-bd2c-3c0d268b16c0 service nova] Acquiring lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4db2ed96-0cfc-43f6-ac13-1c2c9684aeda req-6e19cabe-2d30-40fe-bd2c-3c0d268b16c0 service nova] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4db2ed96-0cfc-43f6-ac13-1c2c9684aeda req-6e19cabe-2d30-40fe-bd2c-3c0d268b16c0 service nova] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-4db2ed96-0cfc-43f6-ac13-1c2c9684aeda req-6e19cabe-2d30-40fe-bd2c-3c0d268b16c0 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] No waiting events found dispatching network-vif-plugged-a2cfad28-beca-4749-8335-a2a69ddcc677 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:09 user nova-compute[75000]: WARNING nova.compute.manager [req-4db2ed96-0cfc-43f6-ac13-1c2c9684aeda req-6e19cabe-2d30-40fe-bd2c-3c0d268b16c0 service nova] [instance: 72e24734-35e3-4e5c-9f8a-85d14397387d] Received unexpected event network-vif-plugged-a2cfad28-beca-4749-8335-a2a69ddcc677 for instance with vm_state deleted and task_state None.
Nov 06 22:46:09 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Deleted allocations for instance 72e24734-35e3-4e5c-9f8a-85d14397387d
Nov 06 22:46:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8a37c73a-df34-45f0-a55a-923ac04a26bd tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "72e24734-35e3-4e5c-9f8a-85d14397387d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.564s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:19 user nova-compute[75000]: DEBUG nova.objects.instance [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:46:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:19 user nova-compute[75000]: INFO nova.compute.manager [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Attaching volume 33ad1462-6917-494d-89a3-e09c1c51579e to /dev/vdb
Nov 06 22:46:20 user nova-compute[75000]: DEBUG os_brick.utils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecae6697-db84-4035-9e93-55edf8b73508]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[354c6ef0-8ac0-49b7-b0d4-752392db7110]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5015769-a7b3-4750-825b-1dc72f4a5c9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b163d8-84fa-49e0-bc9e-63a3da618dbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:46:20 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:46:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b400e7-8e92-4fe4-a55b-72c0db744158]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG os_brick.utils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Updating existing volume attachment record: d27027ca-fbad-44d2-bdba-2c6068d8220a {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:46:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:46:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:27 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:46:27 user nova-compute[75000]: INFO nova.compute.claims [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Claim successful on node user
Nov 06 22:46:28 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:46:28 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:46:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG nova.policy [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d4aa96179fd4121ba224f47c01d9364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828fc01bb744496f83bd0f5d90e6924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:46:28 user nova-compute[75000]: INFO nova.virt.block_device [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Booting with volume d1334b97-bf06-4ffa-9c89-487391fbde7c at /dev/vda
Nov 06 22:46:28 user nova-compute[75000]: DEBUG os_brick.utils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f07479-d080-4117-991e-83887a58ca43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2f67e8-f881-4e28-af13-03459814ec47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[309795b6-0e86-4063-a5ab-94e346e72a20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ca8a4-1c41-4b68-a3e0-2717813f931e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:46:28 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:46:28 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e899a-1662-425f-a32f-66d4a4bf0149]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG os_brick.utils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updating existing volume attachment record: 2064d297-9ee4-4c05-b5d6-c9512f8d2211 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:46:28 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Successfully created port: ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Successfully updated port: ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquired lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-67992397-5da4-45ad-8c4f-e3cbf2d295e4 req-9624e213-60ee-4c77-af5b-805104646f8f service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received event network-changed-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-67992397-5da4-45ad-8c4f-e3cbf2d295e4 req-9624e213-60ee-4c77-af5b-805104646f8f service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Refreshing instance network info cache due to event network-changed-ffa643ce-ec44-4d3d-be6e-766df9e123fc. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-67992397-5da4-45ad-8c4f-e3cbf2d295e4 req-9624e213-60ee-4c77-af5b-805104646f8f service nova] Acquiring lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updating instance_info_cache with network_info: [{"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Releasing lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Instance network_info: |[{"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-67992397-5da4-45ad-8c4f-e3cbf2d295e4 req-9624e213-60ee-4c77-af5b-805104646f8f service nova] Acquired lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:46:29 user nova-compute[75000]: DEBUG nova.network.neutron [req-67992397-5da4-45ad-8c4f-e3cbf2d295e4 req-9624e213-60ee-4c77-af5b-805104646f8f service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Refreshing network info cache for port ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbefGyVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:46:30 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:46:30 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:46:30 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[362143da-c69f-4904-93d0-f34b1e1b9c8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:46:30 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[74653bb0-7d44-460b-b971-d13b9073c2c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c] added
Nov 06 22:46:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab52ea9-2c24-4765-8013-36729117abaa]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb04851-84f4-4f84-88bc-9df99c8266f6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbefGyVN {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbefGyVN" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eda0040-ce42-4c15-9799-804c3698e415]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pbefGyVN'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfa8c33-abea-4177-acf9-5de39365ea3c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[53402770-ae2f-402e-9c91-91e206840122]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG nova.network.neutron [req-67992397-5da4-45ad-8c4f-e3cbf2d295e4 req-9624e213-60ee-4c77-af5b-805104646f8f service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updated VIF entry in instance network info cache for port ffa643ce-ec44-4d3d-be6e-766df9e123fc. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG nova.network.neutron [req-67992397-5da4-45ad-8c4f-e3cbf2d295e4 req-9624e213-60ee-4c77-af5b-805104646f8f service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updating instance_info_cache with network_info: [{"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-67992397-5da4-45ad-8c4f-e3cbf2d295e4 req-9624e213-60ee-4c77-af5b-805104646f8f service nova] Releasing lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37b29d8-47fe-4d35-ba1a-0510a3a10064]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c, portal: 172.16.0.220,3260]
Nov 06 22:46:30 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c, portal: 172.16.0.220,3260] successful.
Nov 06 22:46:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3923199d-dcb0-447d-9146-f1a687d7e75b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad805b-b560-4b3f-b203-67e520993552]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:30 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:30 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc2e78-cfb6-4b01-8bae-056280d29d18]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:46:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbefGyVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:46:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:46:31 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23566616135646538', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:46:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566616135646538', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:46:31 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'flavor' on Instance uuid 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:46:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:46:31 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:46:31 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 22:46:31 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:46:31 user nova-compute[75000]:   <serial>45134703-54d2-40ed-8b34-8e59bcd4fd2c</serial>
Nov 06 22:46:31 user nova-compute[75000]: </disk>
Nov 06 22:46:31 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:46:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:46:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:46:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] No VIF found with MAC fa:16:3e:65:19:c4, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:46:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c250e037-d076-4931-aace-f568031cc996 tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.157s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:46:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:37 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:38 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Skipping network cache update for instance because it is Building. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid 97e834ec-a286-4da9-a6b8-164a1061f042 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updating instance_info_cache with network_info: [{"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-97e834ec-a286-4da9-a6b8-164a1061f042" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:46:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:46:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:42 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:46:42 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:46:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8216MB free_disk=25.125972747802734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 97e834ec-a286-4da9-a6b8-164a1061f042 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance df39e1c2-a3f5-4133-a101-4a7320987e72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f31ab346-0c23-4086-9c16-3322dc972c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:46:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:46:43 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:46:43 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:46:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:46:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:43 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 22:46:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 22:46:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:44 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:46:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:46:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:46:52 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Creating image(s)
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Ensure instance console log exists: /opt/stack/data/nova/instances/6bb78cec-cf14-4bcb-ac7c-b3d57e33b393/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Start _get_guest_xml network_info=[{"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDBCPcWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bb78cec-cf14-4bcb-ac7c-b3d57e33b393', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1334b97-bf06-4ffa-9c89-487391fbde7c', 'serial': 'd1334b97-bf06-4ffa-9c89-487391fbde7c'}, 'attachment_id': '2064d297-9ee4-4c05-b5d6-c9512f8d2211', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:46:52 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:46:52 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDBCPcWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:46:52 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:46:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:46:52 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:46:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:46:52 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[83edbb96-ce69-47e5-bb9a-158d9fe54bcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:46:52 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f539cd-d07f-46ee-9afe-46bd6f716316]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c] added
Nov 06 22:46:52 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41e0142-1402-4d25-a113-f70a3d3c3a62]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0516b7c6-03a9-4d4c-ad37-1a368e94593f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:52 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDBCPcWj {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDBCPcWj" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07cfb07-bf2d-4943-8b33-b397364299c3]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mDBCPcWj'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6236b7-b0aa-4f0e-a27f-d26f32cd5957]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a861b4bb-482b-4174-86c0-fad934b7e73b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:53 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:53 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe85bcf2-247f-45d7-8d7b-a6cf6273cbda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c, portal: 172.16.0.220,3260]
Nov 06 22:46:53 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c, portal: 172.16.0.220,3260] successful.
Nov 06 22:46:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0365cea-e47c-4d23-89fd-b0bbf42a457e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa9b3db-97a1-4c83-b36d-967e23ea0cd4]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:53 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:53 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:46:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:53 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:53 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:46:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0e7b3d-6639-4932-be28-82469639de88]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:53 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDBCPcWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26433383530346635', 'path': '/dev/sdd'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433383530346635', 'path': '/dev/sdd'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-181185970',display_name='tempest-TestVolumeBootPattern-volume-backed-server-181185970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-181185970',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHMvJtV4S48O3BWv7tZVQsgO3omOWcAD8W2qxKCaxRBpaWa/qUuSPB72d8wy5WR1vLcXgmaddVh249KC30F0xrnws6vl1XvHKwY1GhIUSzz28vYP2XS28x8M3gSFWYOMg==',key_name='tempest-keypair-469512859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-cpcl4f8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:46:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=6bb78cec-cf14-4bcb-ac7c-b3d57e33b393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:2f:30,bridge_name='br-int',has_traffic_filtering=True,id=ffa643ce-ec44-4d3d-be6e-766df9e123fc,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa643ce-ec') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:46:54 user nova-compute[75000]:   <uuid>6bb78cec-cf14-4bcb-ac7c-b3d57e33b393</uuid>
Nov 06 22:46:54 user nova-compute[75000]:   <name>instance-00000026</name>
Nov 06 22:46:54 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:46:54 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:46:54 user nova-compute[75000]:   <metadata>
Nov 06 22:46:54 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:46:54 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:46:54 user nova-compute[75000]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-181185970</nova:name>
Nov 06 22:46:54 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:46:52</nova:creationTime>
Nov 06 22:46:54 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:46:54 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:46:54 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:46:54 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:46:54 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:46:54 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:46:54 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:46:54 user nova-compute[75000]:       <nova:owner>
Nov 06 22:46:54 user nova-compute[75000]:         <nova:user uuid="0d4aa96179fd4121ba224f47c01d9364">tempest-TestVolumeBootPattern-673062967-project-member</nova:user>
Nov 06 22:46:54 user nova-compute[75000]:         <nova:project uuid="828fc01bb744496f83bd0f5d90e6924f">tempest-TestVolumeBootPattern-673062967</nova:project>
Nov 06 22:46:54 user nova-compute[75000]:       </nova:owner>
Nov 06 22:46:54 user nova-compute[75000]:       <nova:ports>
Nov 06 22:46:54 user nova-compute[75000]:         <nova:port uuid="ffa643ce-ec44-4d3d-be6e-766df9e123fc">
Nov 06 22:46:54 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 22:46:54 user nova-compute[75000]:         </nova:port>
Nov 06 22:46:54 user nova-compute[75000]:       </nova:ports>
Nov 06 22:46:54 user nova-compute[75000]:     </nova:instance>
Nov 06 22:46:54 user nova-compute[75000]:   </metadata>
Nov 06 22:46:54 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:46:54 user nova-compute[75000]:     <system>
Nov 06 22:46:54 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:46:54 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:46:54 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:46:54 user nova-compute[75000]:       <entry name="serial">6bb78cec-cf14-4bcb-ac7c-b3d57e33b393</entry>
Nov 06 22:46:54 user nova-compute[75000]:       <entry name="uuid">6bb78cec-cf14-4bcb-ac7c-b3d57e33b393</entry>
Nov 06 22:46:54 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:46:54 user nova-compute[75000]:     </system>
Nov 06 22:46:54 user nova-compute[75000]:   </sysinfo>
Nov 06 22:46:54 user nova-compute[75000]:   <os>
Nov 06 22:46:54 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:46:54 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:46:54 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:46:54 user nova-compute[75000]:   </os>
Nov 06 22:46:54 user nova-compute[75000]:   <features>
Nov 06 22:46:54 user nova-compute[75000]:     <acpi/>
Nov 06 22:46:54 user nova-compute[75000]:     <apic/>
Nov 06 22:46:54 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:46:54 user nova-compute[75000]:   </features>
Nov 06 22:46:54 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:46:54 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:46:54 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:46:54 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:46:54 user nova-compute[75000]:   </clock>
Nov 06 22:46:54 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:46:54 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:46:54 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:46:54 user nova-compute[75000]:   </cpu>
Nov 06 22:46:54 user nova-compute[75000]:   <devices>
Nov 06 22:46:54 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:46:54 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:46:54 user nova-compute[75000]:       <source dev="/dev/sdd"/>
Nov 06 22:46:54 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:46:54 user nova-compute[75000]:       <serial>d1334b97-bf06-4ffa-9c89-487391fbde7c</serial>
Nov 06 22:46:54 user nova-compute[75000]:     </disk>
Nov 06 22:46:54 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:46:54 user nova-compute[75000]:       <mac address="fa:16:3e:07:2f:30"/>
Nov 06 22:46:54 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:46:54 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:46:54 user nova-compute[75000]:       <target dev="tapffa643ce-ec"/>
Nov 06 22:46:54 user nova-compute[75000]:     </interface>
Nov 06 22:46:54 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:46:54 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/6bb78cec-cf14-4bcb-ac7c-b3d57e33b393/console.log" append="off"/>
Nov 06 22:46:54 user nova-compute[75000]:     </serial>
Nov 06 22:46:54 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:46:54 user nova-compute[75000]:     <video>
Nov 06 22:46:54 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:46:54 user nova-compute[75000]:     </video>
Nov 06 22:46:54 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:46:54 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:46:54 user nova-compute[75000]:     </rng>
Nov 06 22:46:54 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:46:54 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:46:54 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:46:54 user nova-compute[75000]:     </memballoon>
Nov 06 22:46:54 user nova-compute[75000]:   </devices>
Nov 06 22:46:54 user nova-compute[75000]: </domain>
Nov 06 22:46:54 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-181185970',display_name='tempest-TestVolumeBootPattern-volume-backed-server-181185970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-181185970',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHMvJtV4S48O3BWv7tZVQsgO3omOWcAD8W2qxKCaxRBpaWa/qUuSPB72d8wy5WR1vLcXgmaddVh249KC30F0xrnws6vl1XvHKwY1GhIUSzz28vYP2XS28x8M3gSFWYOMg==',key_name='tempest-keypair-469512859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-cpcl4f8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:46:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=6bb78cec-cf14-4bcb-ac7c-b3d57e33b393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:2f:30,bridge_name='br-int',has_traffic_filtering=True,id=ffa643ce-ec44-4d3d-be6e-766df9e123fc,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa643ce-ec') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG os_vif [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:2f:30,bridge_name='br-int',has_traffic_filtering=True,id=ffa643ce-ec44-4d3d-be6e-766df9e123fc,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa643ce-ec') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '248a6e5e-a306-5653-82c3-93170ae20ed1', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffa643ce-ec, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffa643ce-ec, col_values=(('qos', UUID('606ab5ac-5321-44b5-88de-5c3a6a5323dd')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffa643ce-ec, col_values=(('external_ids', {'iface-id': 'ffa643ce-ec44-4d3d-be6e-766df9e123fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:2f:30', 'vm-uuid': '6bb78cec-cf14-4bcb-ac7c-b3d57e33b393'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:54 user nova-compute[75000]: INFO os_vif [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:2f:30,bridge_name='br-int',has_traffic_filtering=True,id=ffa643ce-ec44-4d3d-be6e-766df9e123fc,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa643ce-ec')
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:46:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No VIF found with MAC fa:16:3e:07:2f:30, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:46:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-f15563f5-0ad7-4965-bc16-5caa227505d9 req-f995f186-ff70-4c42-bc61-9e663cbfb161 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received event network-vif-plugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f15563f5-0ad7-4965-bc16-5caa227505d9 req-f995f186-ff70-4c42-bc61-9e663cbfb161 service nova] Acquiring lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f15563f5-0ad7-4965-bc16-5caa227505d9 req-f995f186-ff70-4c42-bc61-9e663cbfb161 service nova] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f15563f5-0ad7-4965-bc16-5caa227505d9 req-f995f186-ff70-4c42-bc61-9e663cbfb161 service nova] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-f15563f5-0ad7-4965-bc16-5caa227505d9 req-f995f186-ff70-4c42-bc61-9e663cbfb161 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] No waiting events found dispatching network-vif-plugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:56 user nova-compute[75000]: WARNING nova.compute.manager [req-f15563f5-0ad7-4965-bc16-5caa227505d9 req-f995f186-ff70-4c42-bc61-9e663cbfb161 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received unexpected event network-vif-plugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc for instance with vm_state building and task_state spawning.
Nov 06 22:46:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "97e834ec-a286-4da9-a6b8-164a1061f042" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "97e834ec-a286-4da9-a6b8-164a1061f042" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:56 user nova-compute[75000]: INFO nova.compute.manager [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Terminating instance
Nov 06 22:46:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-fc2cd020-0d79-427a-b40b-ce21016406a2 req-f753d054-2c21-400f-8a86-84e2dcdd1d47 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received event network-vif-unplugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fc2cd020-0d79-427a-b40b-ce21016406a2 req-f753d054-2c21-400f-8a86-84e2dcdd1d47 service nova] Acquiring lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fc2cd020-0d79-427a-b40b-ce21016406a2 req-f753d054-2c21-400f-8a86-84e2dcdd1d47 service nova] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fc2cd020-0d79-427a-b40b-ce21016406a2 req-f753d054-2c21-400f-8a86-84e2dcdd1d47 service nova] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-fc2cd020-0d79-427a-b40b-ce21016406a2 req-f753d054-2c21-400f-8a86-84e2dcdd1d47 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] No waiting events found dispatching network-vif-unplugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-fc2cd020-0d79-427a-b40b-ce21016406a2 req-f753d054-2c21-400f-8a86-84e2dcdd1d47 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received event network-vif-unplugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:46:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Instance destroyed successfully.
Nov 06 22:46:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lazy-loading 'resources' on Instance uuid 97e834ec-a286-4da9-a6b8-164a1061f042 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:25:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-217377317',display_name='tempest-ServerActionsTestOtherA-server-217377317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-217377317',id=3,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWWSt8DqD1UiX7y0P2zcc1XaSgfLqWPMHCsT4qhuCpJN/KYahOdMyvjBaIfA8wTAtF3OG7T0GjKSjZNjN+adINTC3kMpTN5nU53yfK9kl9yrZK3oIAKJYF1R8Z+Truelg==',key_name='tempest-keypair-832438895',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:25:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c931a6fc1f8a405f83293c6685dc016e',ramdisk_id='',reservation_id='r-4oc6tofp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-287714099',owner_user_name='tempest-ServerActionsTestOtherA-287714099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b8ec49509748aab2ab06755faf2a2d',uuid=97e834ec-a286-4da9-a6b8-164a1061f042,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converting VIF {"id": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "address": "fa:16:3e:27:2c:98", "network": {"id": "8de4cb61-6612-40ca-a78b-699ef739876e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1437787295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931a6fc1f8a405f83293c6685dc016e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a108ec5-37", "ovs_interfaceid": "7a108ec5-3780-43e6-a8da-e1a44ecffd8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:2c:98,bridge_name='br-int',has_traffic_filtering=True,id=7a108ec5-3780-43e6-a8da-e1a44ecffd8e,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a108ec5-37') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG os_vif [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:2c:98,bridge_name='br-int',has_traffic_filtering=True,id=7a108ec5-3780-43e6-a8da-e1a44ecffd8e,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a108ec5-37') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a108ec5-37, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9be09d3f-07c3-4ffe-ad93-38720ee0e721) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:46:57 user nova-compute[75000]: INFO os_vif [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:2c:98,bridge_name='br-int',has_traffic_filtering=True,id=7a108ec5-3780-43e6-a8da-e1a44ecffd8e,network=Network(8de4cb61-6612-40ca-a78b-699ef739876e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a108ec5-37')
Nov 06 22:46:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Deleting instance files /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042_del
Nov 06 22:46:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Deletion of /opt/stack/data/nova/instances/97e834ec-a286-4da9-a6b8-164a1061f042_del complete
Nov 06 22:46:57 user nova-compute[75000]: INFO nova.compute.manager [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 22:46:57 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:46:57 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:46:58 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Took 0.45 seconds to deallocate network for instance.
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:46:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Instance spawned successfully.
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-8f2eeb45-8965-4a60-9ddd-711b0fb64b1d req-dfce9931-2b23-4a59-9a77-8819e678a039 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received event network-vif-plugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8f2eeb45-8965-4a60-9ddd-711b0fb64b1d req-dfce9931-2b23-4a59-9a77-8819e678a039 service nova] Acquiring lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8f2eeb45-8965-4a60-9ddd-711b0fb64b1d req-dfce9931-2b23-4a59-9a77-8819e678a039 service nova] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8f2eeb45-8965-4a60-9ddd-711b0fb64b1d req-dfce9931-2b23-4a59-9a77-8819e678a039 service nova] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-8f2eeb45-8965-4a60-9ddd-711b0fb64b1d req-dfce9931-2b23-4a59-9a77-8819e678a039 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] No waiting events found dispatching network-vif-plugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:58 user nova-compute[75000]: WARNING nova.compute.manager [req-8f2eeb45-8965-4a60-9ddd-711b0fb64b1d req-dfce9931-2b23-4a59-9a77-8819e678a039 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received unexpected event network-vif-plugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc for instance with vm_state building and task_state spawning.
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-8f2eeb45-8965-4a60-9ddd-711b0fb64b1d req-dfce9931-2b23-4a59-9a77-8819e678a039 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received event network-vif-deleted-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:46:58 user nova-compute[75000]: INFO nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:46:58 user nova-compute[75000]: INFO nova.compute.manager [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Took 30.60 seconds to build instance.
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a78b8b7c-e273-4c33-8e4d-be9329739987 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.701s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.803s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:58 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Deleted allocations for instance 97e834ec-a286-4da9-a6b8-164a1061f042
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-87c08d5d-65b0-4222-bd76-e50f9d1c01bb req-d0098d33-1bb6-422c-bfa0-c2870c602af8 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received event network-vif-plugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87c08d5d-65b0-4222-bd76-e50f9d1c01bb req-d0098d33-1bb6-422c-bfa0-c2870c602af8 service nova] Acquiring lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87c08d5d-65b0-4222-bd76-e50f9d1c01bb req-d0098d33-1bb6-422c-bfa0-c2870c602af8 service nova] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87c08d5d-65b0-4222-bd76-e50f9d1c01bb req-d0098d33-1bb6-422c-bfa0-c2870c602af8 service nova] Lock "97e834ec-a286-4da9-a6b8-164a1061f042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-87c08d5d-65b0-4222-bd76-e50f9d1c01bb req-d0098d33-1bb6-422c-bfa0-c2870c602af8 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] No waiting events found dispatching network-vif-plugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:46:58 user nova-compute[75000]: WARNING nova.compute.manager [req-87c08d5d-65b0-4222-bd76-e50f9d1c01bb req-d0098d33-1bb6-422c-bfa0-c2870c602af8 service nova] [instance: 97e834ec-a286-4da9-a6b8-164a1061f042] Received unexpected event network-vif-plugged-7a108ec5-3780-43e6-a8da-e1a44ecffd8e for instance with vm_state deleted and task_state None.
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cef3d3e7-e781-4ce4-9366-72193bee5168 tempest-ServerActionsTestOtherA-287714099 tempest-ServerActionsTestOtherA-287714099-project-member] Lock "97e834ec-a286-4da9-a6b8-164a1061f042" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.542s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHGQOEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:46:59 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:46:59 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:46:59 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f961d917-75fd-4946-9459-1523d49a9d7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:46:59 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf817d0-dc03-47d4-9a44-0373f519ed3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e] added
Nov 06 22:46:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f5aceb-0c89-4dc9-ac3b-049f7f30d888]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f78b3f-4776-4dd1-83f2-74b086e95894]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxHGQOEn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxHGQOEn" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2d11d-57c6-4833-b861-cda6ca63f137]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gxHGQOEn'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[236e48b6-248f-4383-8563-382678e6c9da]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8d884c-8d3d-43d0-93f5-547626dcd89c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:46:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:46:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[46662679-5385-498a-9e9b-f2ffd5cd994e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e, portal: 172.16.0.220,3260]
Nov 06 22:46:59 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e, portal: 172.16.0.220,3260] successful.
Nov 06 22:46:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ea01eb-5139-41f8-935b-ce6dbca7a93d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9099db-d61c-4f92-a7c4-b72ab7380b4d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:46:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:46:59 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:46:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e8a3e-6100-46ff-a37c-28ea77dc3f6c]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:46:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHGQOEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:47:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:47:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26337636433376530', 'path': '/dev/sde'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:47:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337636433376530', 'path': '/dev/sde'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:47:00 user nova-compute[75000]: DEBUG nova.objects.instance [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:47:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:47:00 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:47:00 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:47:00 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:47:00 user nova-compute[75000]:   <serial>33ad1462-6917-494d-89a3-e09c1c51579e</serial>
Nov 06 22:47:00 user nova-compute[75000]: </disk>
Nov 06 22:47:00 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:47:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:47:01 user nova-compute[75000]: INFO nova.compute.claims [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Claim successful on node user
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No VIF found with MAC fa:16:3e:f1:14:63, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2bfe10ad-a2dd-4d19-86cb-73611ee2276f tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.539s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:47:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.policy [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33f333b132a1474d983798ab0642b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf4f6360f6c486ab24087a20da8b6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:47:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Creating image(s)
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "/opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "/opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk 1073741824" returned: 0 in 0.076s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Successfully created port: fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.214s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Cannot resize image /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Ensure instance console log exists: /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.network.neutron [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Successfully updated port: fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "refresh_cache-ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquired lock "refresh_cache-ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.network.neutron [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-f2ddf82f-aa8a-42dc-9e08-85afdb2e4659 req-834399e8-5d34-4be7-89af-7b75f75b9c7e service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received event network-changed-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-f2ddf82f-aa8a-42dc-9e08-85afdb2e4659 req-834399e8-5d34-4be7-89af-7b75f75b9c7e service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Refreshing instance network info cache due to event network-changed-fb7843bb-4d08-4a40-843c-ff217cfa0561. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f2ddf82f-aa8a-42dc-9e08-85afdb2e4659 req-834399e8-5d34-4be7-89af-7b75f75b9c7e service nova] Acquiring lock "refresh_cache-ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.network.neutron [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.network.neutron [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Updating instance_info_cache with network_info: [{"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Releasing lock "refresh_cache-ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Instance network_info: |[{"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f2ddf82f-aa8a-42dc-9e08-85afdb2e4659 req-834399e8-5d34-4be7-89af-7b75f75b9c7e service nova] Acquired lock "refresh_cache-ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.network.neutron [req-f2ddf82f-aa8a-42dc-9e08-85afdb2e4659 req-834399e8-5d34-4be7-89af-7b75f75b9c7e service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Refreshing network info cache for port fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Start _get_guest_xml network_info=[{"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:47:03 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:47:03 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-477443641',display_name='tempest-AttachVolumeNegativeTest-server-477443641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-477443641',id=39,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL3Bbh6y33cUMLqgWGYRx9yDYyUaPjePeP04gkuDis02HkMNVZlzpIi7+amhsiGbmP8ErNj7cItToQqWuml/0oiZZymyD/lkBKALg+wUVVW9PelOxnRPGy3k/W6Qm9UZw==',key_name='tempest-keypair-1646731834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-juw3qtay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:ce,bridge_name='br-int',has_traffic_filtering=True,id=fb7843bb-4d08-4a40-843c-ff217cfa0561,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7843bb-4d') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.objects.instance [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'pci_devices' on Instance uuid ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:47:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:47:03 user nova-compute[75000]:   <uuid>ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61</uuid>
Nov 06 22:47:03 user nova-compute[75000]:   <name>instance-00000027</name>
Nov 06 22:47:03 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:47:03 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:47:03 user nova-compute[75000]:   <metadata>
Nov 06 22:47:03 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:47:03 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:47:03 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeNegativeTest-server-477443641</nova:name>
Nov 06 22:47:03 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:47:03</nova:creationTime>
Nov 06 22:47:03 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:47:03 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:47:03 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:47:03 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:47:03 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:47:03 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:47:03 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:47:03 user nova-compute[75000]:       <nova:owner>
Nov 06 22:47:03 user nova-compute[75000]:         <nova:user uuid="33f333b132a1474d983798ab0642b053">tempest-AttachVolumeNegativeTest-90304964-project-member</nova:user>
Nov 06 22:47:03 user nova-compute[75000]:         <nova:project uuid="0cf4f6360f6c486ab24087a20da8b6cb">tempest-AttachVolumeNegativeTest-90304964</nova:project>
Nov 06 22:47:03 user nova-compute[75000]:       </nova:owner>
Nov 06 22:47:03 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:47:03 user nova-compute[75000]:       <nova:ports>
Nov 06 22:47:03 user nova-compute[75000]:         <nova:port uuid="fb7843bb-4d08-4a40-843c-ff217cfa0561">
Nov 06 22:47:03 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 22:47:03 user nova-compute[75000]:         </nova:port>
Nov 06 22:47:03 user nova-compute[75000]:       </nova:ports>
Nov 06 22:47:03 user nova-compute[75000]:     </nova:instance>
Nov 06 22:47:03 user nova-compute[75000]:   </metadata>
Nov 06 22:47:03 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:47:03 user nova-compute[75000]:     <system>
Nov 06 22:47:03 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:47:03 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:47:03 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:47:03 user nova-compute[75000]:       <entry name="serial">ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61</entry>
Nov 06 22:47:03 user nova-compute[75000]:       <entry name="uuid">ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61</entry>
Nov 06 22:47:03 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:47:03 user nova-compute[75000]:     </system>
Nov 06 22:47:03 user nova-compute[75000]:   </sysinfo>
Nov 06 22:47:03 user nova-compute[75000]:   <os>
Nov 06 22:47:03 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:47:03 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:47:03 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:47:03 user nova-compute[75000]:   </os>
Nov 06 22:47:03 user nova-compute[75000]:   <features>
Nov 06 22:47:03 user nova-compute[75000]:     <acpi/>
Nov 06 22:47:03 user nova-compute[75000]:     <apic/>
Nov 06 22:47:03 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:47:03 user nova-compute[75000]:   </features>
Nov 06 22:47:03 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:47:03 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:47:03 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:47:03 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:47:03 user nova-compute[75000]:   </clock>
Nov 06 22:47:03 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:47:03 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:47:03 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:47:03 user nova-compute[75000]:   </cpu>
Nov 06 22:47:03 user nova-compute[75000]:   <devices>
Nov 06 22:47:03 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:47:03 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:47:03 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk"/>
Nov 06 22:47:03 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:47:03 user nova-compute[75000]:     </disk>
Nov 06 22:47:03 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:47:03 user nova-compute[75000]:       <mac address="fa:16:3e:f2:47:ce"/>
Nov 06 22:47:03 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:47:03 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:47:03 user nova-compute[75000]:       <target dev="tapfb7843bb-4d"/>
Nov 06 22:47:03 user nova-compute[75000]:     </interface>
Nov 06 22:47:03 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:47:03 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/console.log" append="off"/>
Nov 06 22:47:03 user nova-compute[75000]:     </serial>
Nov 06 22:47:03 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:47:03 user nova-compute[75000]:     <video>
Nov 06 22:47:03 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:47:03 user nova-compute[75000]:     </video>
Nov 06 22:47:03 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:47:03 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:47:03 user nova-compute[75000]:     </rng>
Nov 06 22:47:03 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:47:03 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:47:03 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:47:03 user nova-compute[75000]:     </memballoon>
Nov 06 22:47:03 user nova-compute[75000]:   </devices>
Nov 06 22:47:03 user nova-compute[75000]: </domain>
Nov 06 22:47:03 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-477443641',display_name='tempest-AttachVolumeNegativeTest-server-477443641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-477443641',id=39,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL3Bbh6y33cUMLqgWGYRx9yDYyUaPjePeP04gkuDis02HkMNVZlzpIi7+amhsiGbmP8ErNj7cItToQqWuml/0oiZZymyD/lkBKALg+wUVVW9PelOxnRPGy3k/W6Qm9UZw==',key_name='tempest-keypair-1646731834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-juw3qtay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:ce,bridge_name='br-int',has_traffic_filtering=True,id=fb7843bb-4d08-4a40-843c-ff217cfa0561,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7843bb-4d') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG os_vif [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:ce,bridge_name='br-int',has_traffic_filtering=True,id=fb7843bb-4d08-4a40-843c-ff217cfa0561,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7843bb-4d') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d7422d0-16a6-5e0d-a601-16eac9716c9d', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb7843bb-4d, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb7843bb-4d, col_values=(('qos', UUID('c8945b77-195d-4cee-9f8f-1afc2a67bafe')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb7843bb-4d, col_values=(('external_ids', {'iface-id': 'fb7843bb-4d08-4a40-843c-ff217cfa0561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:47:ce', 'vm-uuid': 'ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:04 user nova-compute[75000]: INFO os_vif [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:ce,bridge_name='br-int',has_traffic_filtering=True,id=fb7843bb-4d08-4a40-843c-ff217cfa0561,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7843bb-4d')
Nov 06 22:47:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No VIF found with MAC fa:16:3e:f2:47:ce, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG nova.network.neutron [req-f2ddf82f-aa8a-42dc-9e08-85afdb2e4659 req-834399e8-5d34-4be7-89af-7b75f75b9c7e service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Updated VIF entry in instance network info cache for port fb7843bb-4d08-4a40-843c-ff217cfa0561. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG nova.network.neutron [req-f2ddf82f-aa8a-42dc-9e08-85afdb2e4659 req-834399e8-5d34-4be7-89af-7b75f75b9c7e service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Updating instance_info_cache with network_info: [{"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:47:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f2ddf82f-aa8a-42dc-9e08-85afdb2e4659 req-834399e8-5d34-4be7-89af-7b75f75b9c7e service nova] Releasing lock "refresh_cache-ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:47:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-9bc8d2be-7225-44fe-9420-ff8cbd422b33 req-ed93ac4b-9097-4eb1-a4ce-e47ca020da8f service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received event network-vif-plugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:47:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9bc8d2be-7225-44fe-9420-ff8cbd422b33 req-ed93ac4b-9097-4eb1-a4ce-e47ca020da8f service nova] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9bc8d2be-7225-44fe-9420-ff8cbd422b33 req-ed93ac4b-9097-4eb1-a4ce-e47ca020da8f service nova] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9bc8d2be-7225-44fe-9420-ff8cbd422b33 req-ed93ac4b-9097-4eb1-a4ce-e47ca020da8f service nova] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-9bc8d2be-7225-44fe-9420-ff8cbd422b33 req-ed93ac4b-9097-4eb1-a4ce-e47ca020da8f service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] No waiting events found dispatching network-vif-plugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:47:05 user nova-compute[75000]: WARNING nova.compute.manager [req-9bc8d2be-7225-44fe-9420-ff8cbd422b33 req-ed93ac4b-9097-4eb1-a4ce-e47ca020da8f service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received unexpected event network-vif-plugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 for instance with vm_state building and task_state spawning.
Nov 06 22:47:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-ff2d1b44-5e6e-4c49-9fdd-50fe103bee02 req-f31c68eb-6dd6-49a3-bc79-8699cf945f77 service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received event network-vif-plugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:47:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ff2d1b44-5e6e-4c49-9fdd-50fe103bee02 req-f31c68eb-6dd6-49a3-bc79-8699cf945f77 service nova] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ff2d1b44-5e6e-4c49-9fdd-50fe103bee02 req-f31c68eb-6dd6-49a3-bc79-8699cf945f77 service nova] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ff2d1b44-5e6e-4c49-9fdd-50fe103bee02 req-f31c68eb-6dd6-49a3-bc79-8699cf945f77 service nova] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-ff2d1b44-5e6e-4c49-9fdd-50fe103bee02 req-f31c68eb-6dd6-49a3-bc79-8699cf945f77 service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] No waiting events found dispatching network-vif-plugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:47:07 user nova-compute[75000]: WARNING nova.compute.manager [req-ff2d1b44-5e6e-4c49-9fdd-50fe103bee02 req-f31c68eb-6dd6-49a3-bc79-8699cf945f77 service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received unexpected event network-vif-plugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 for instance with vm_state building and task_state spawning.
Nov 06 22:47:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:47:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:47:07 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Instance spawned successfully.
Nov 06 22:47:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:47:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:47:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:47:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:47:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:47:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:47:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:47:08 user nova-compute[75000]: INFO nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 06 22:47:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:47:08 user nova-compute[75000]: INFO nova.compute.manager [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Took 7.11 seconds to build instance.
Nov 06 22:47:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-656e49c6-8e7b-4488-80b8-d16dd6cf8ee1 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.242s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:09 user nova-compute[75000]: DEBUG nova.objects.instance [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:47:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:09 user nova-compute[75000]: INFO nova.compute.manager [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Attaching volume 4157946b-2921-42a8-bf47-0d0a3defa1ab to /dev/vdc
Nov 06 22:47:10 user nova-compute[75000]: DEBUG os_brick.utils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed9d79-22a6-4dbc-94d8-86c288c37af2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.080s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b0df7-8aef-440f-a0a1-5d0498ac823e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d3f7cd-2a49-405a-95a1-1234d0648a32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c422844-9c1f-4db5-a511-1083210eae5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:47:10 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:47:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f4cbdc-4951-43c5-a616-b8a748f93745]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG os_brick.utils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== get_connector_properties: return (261ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Updating existing volume attachment record: b3079733-60c4-4739-b0cb-cd072274a8e8 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:47:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:26 user nova-compute[75000]: INFO nova.compute.manager [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Detaching volume 2d15d74e-17fa-4d73-9445-4a19e172499e
Nov 06 22:47:26 user nova-compute[75000]: INFO nova.virt.block_device [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Attempting to driver detach volume 2d15d74e-17fa-4d73-9445-4a19e172499e from mountpoint /dev/vdc
Nov 06 22:47:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Attempting to detach device vdc from instance f31ab346-0c23-4086-9c16-3322dc972c5f from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:47:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:47:26 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:47:26 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:47:26 user nova-compute[75000]:   <target dev="vdc" bus="virtio"/>
Nov 06 22:47:26 user nova-compute[75000]:   <serial>2d15d74e-17fa-4d73-9445-4a19e172499e</serial>
Nov 06 22:47:26 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 22:47:26 user nova-compute[75000]: </disk>
Nov 06 22:47:26 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:47:26 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully detached device vdc from instance f31ab346-0c23-4086-9c16-3322dc972c5f from the persistent domain config.
Nov 06 22:47:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f31ab346-0c23-4086-9c16-3322dc972c5f from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:47:26 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:47:26 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:47:26 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:47:26 user nova-compute[75000]:   <target dev="vdc" bus="virtio"/>
Nov 06 22:47:26 user nova-compute[75000]:   <serial>2d15d74e-17fa-4d73-9445-4a19e172499e</serial>
Nov 06 22:47:26 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 22:47:26 user nova-compute[75000]: </disk>
Nov 06 22:47:26 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:47:27 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:47:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCfOYjnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:47:35 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:47:35 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:47:35 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef9a734-e91c-4911-bcb1-30a8675d0df3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:47:35 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb282a32-f623-478b-ae6d-3ba5d5d111e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab] added
Nov 06 22:47:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a12e10-52ed-44b5-ad1a-c9677f016651]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.108s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e43e10d-99f5-4789-8c54-6277010825c3]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BCfOYjnq {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BCfOYjnq" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d9fdea-7525-4e13-9efe-416c632c1a83]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BCfOYjnq'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad2f82-a880-4368-a99c-c08a15326b01]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[144e980e-f4f5-4c8d-af3a-30daad646e7d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:47:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:47:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece5b34-a270-4ff0-86e0-d61d3464af1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab, portal: 172.16.0.220,3260]
Nov 06 22:47:35 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab, portal: 172.16.0.220,3260] successful.
Nov 06 22:47:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[03476481-2e7b-4212-9194-6841b64574ad]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0194ab-457d-4944-8e38-910427fdb45d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:47:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:47:35 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:47:35 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac939b6-a339-4ab5-9049-57fbd73014ed]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCfOYjnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:47:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:47:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23665636231313031', 'path': '/dev/sdf'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:47:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665636231313031', 'path': '/dev/sdf'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:47:36 user nova-compute[75000]: DEBUG nova.objects.instance [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:47:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:47:36 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:47:36 user nova-compute[75000]:   <source dev="/dev/sdf"/>
Nov 06 22:47:36 user nova-compute[75000]:   <target dev="vdc" bus="virtio"/>
Nov 06 22:47:36 user nova-compute[75000]:   <serial>4157946b-2921-42a8-bf47-0d0a3defa1ab</serial>
Nov 06 22:47:36 user nova-compute[75000]: </disk>
Nov 06 22:47:36 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:47:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:47:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:47:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:47:36 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] No VIF found with MAC fa:16:3e:f1:14:63, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:47:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-cbebd482-753d-45ab-8af4-46c9d5452d7c tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.143s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:37 user nova-compute[75000]: INFO nova.compute.manager [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Detaching volume 33ad1462-6917-494d-89a3-e09c1c51579e
Nov 06 22:47:38 user nova-compute[75000]: INFO nova.virt.block_device [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Attempting to driver detach volume 33ad1462-6917-494d-89a3-e09c1c51579e from mountpoint /dev/vdb
Nov 06 22:47:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Attempting to detach device vdb from instance df39e1c2-a3f5-4133-a101-4a7320987e72 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:47:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:47:38 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:47:38 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:47:38 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:47:38 user nova-compute[75000]:   <serial>33ad1462-6917-494d-89a3-e09c1c51579e</serial>
Nov 06 22:47:38 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:47:38 user nova-compute[75000]: </disk>
Nov 06 22:47:38 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:47:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully detached device vdb from instance df39e1c2-a3f5-4133-a101-4a7320987e72 from the persistent domain config.
Nov 06 22:47:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df39e1c2-a3f5-4133-a101-4a7320987e72 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:47:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:47:38 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:47:38 user nova-compute[75000]:   <source dev="/dev/sde"/>
Nov 06 22:47:38 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:47:38 user nova-compute[75000]:   <serial>33ad1462-6917-494d-89a3-e09c1c51579e</serial>
Nov 06 22:47:38 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:47:38 user nova-compute[75000]: </disk>
Nov 06 22:47:38 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:47:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:47:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:47:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:43 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:47:43 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8003MB free_disk=25.120071411132812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.009s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance df39e1c2-a3f5-4133-a101-4a7320987e72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f31ab346-0c23-4086-9c16-3322dc972c5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:47:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:44 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:47:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:47:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:47:44 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:47:45 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating instance_info_cache with network_info: [{"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:47:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:47:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:47:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:47:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:47 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f31ab346-0c23-4086-9c16-3322dc972c5f is timed out.
Nov 06 22:47:47 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully detached device vdc from instance f31ab346-0c23-4086-9c16-3322dc972c5f from the live domain config.
Nov 06 22:47:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFmyCMAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:47:47 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.012s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1978629-6954-4764-8a1e-7024d94a4d71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:47:47 user nova-compute[75000]: No targets found.
Nov 06 22:47:47 user nova-compute[75000]: iSNS:
Nov 06 22:47:47 user nova-compute[75000]: No targets found.
Nov 06 22:47:47 user nova-compute[75000]: STATIC:
Nov 06 22:47:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c
Nov 06 22:47:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:47:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:47:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab
Nov 06 22:47:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:47:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:47:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e
Nov 06 22:47:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:47:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:47:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c
Nov 06 22:47:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:47:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:47:47 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e
Nov 06 22:47:47 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:47:47 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:47:47 user nova-compute[75000]: FIRMWARE:
Nov 06 22:47:47 user nova-compute[75000]: No targets found.
Nov 06 22:47:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:47:47 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:47:47 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38200dea-7719-422a-85f6-dfbfc1360739]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5dcc46-2b81-4a2d-873c-306d1f4f1df8]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:47:47 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:47:47 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:47:47 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:47:47 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:47:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e (non-flash)
Nov 06 22:47:47 user nova-compute[75000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:47:47 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:47:47 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:47:47 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:47:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc790310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f8654f-f94d-4839-beef-e3259cdeef7a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[04706c1e-b9cf-412c-99ca-25f7d911274c]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[248771db-f696-4e0e-9631-52d3bb3a0a97]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[935f28b6-bb27-47fa-be4e-326b77e9e994]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d1bb2e-5cb9-459d-bb82-3aa37f2503f3]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[007ec2fe-e63d-4564-8860-25d7c33c9f59]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e, portal: 172.16.0.220,3260]
Nov 06 22:47:47 user nova-compute[75000]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e, portal: 172.16.0.220,3260] successful.
Nov 06 22:47:47 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d15d74e-17fa-4d73-9445-4a19e172499e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b9eaf-27e4-4c4c-a37d-dac989b24725]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] <== disconnect_volume: return (397ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:47:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:47:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'flavor' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:47:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-344e785c-42af-4ca6-b52b-0f5a00151380 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.478s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:50 user nova-compute[75000]: INFO nova.compute.manager [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Detaching volume 45134703-54d2-40ed-8b34-8e59bcd4fd2c
Nov 06 22:47:50 user nova-compute[75000]: INFO nova.virt.block_device [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Attempting to driver detach volume 45134703-54d2-40ed-8b34-8e59bcd4fd2c from mountpoint /dev/vdb
Nov 06 22:47:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Attempting to detach device vdb from instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:47:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:47:50 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:47:50 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 22:47:50 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:47:50 user nova-compute[75000]:   <serial>45134703-54d2-40ed-8b34-8e59bcd4fd2c</serial>
Nov 06 22:47:50 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:47:50 user nova-compute[75000]: </disk>
Nov 06 22:47:50 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:47:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Successfully detached device vdb from instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 from the persistent domain config.
Nov 06 22:47:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:47:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:47:50 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:47:50 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 22:47:50 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:47:50 user nova-compute[75000]:   <serial>45134703-54d2-40ed-8b34-8e59bcd4fd2c</serial>
Nov 06 22:47:50 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:47:50 user nova-compute[75000]: </disk>
Nov 06 22:47:50 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:47:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:47:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:55 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:47:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:58 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance df39e1c2-a3f5-4133-a101-4a7320987e72 is timed out.
Nov 06 22:47:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully detached device vdb from instance df39e1c2-a3f5-4133-a101-4a7320987e72 from the live domain config.
Nov 06 22:47:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxHGQOEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:47:58 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0022b98b-9d3b-4156-b601-79936121af60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:47:58 user nova-compute[75000]: No targets found.
Nov 06 22:47:58 user nova-compute[75000]: iSNS:
Nov 06 22:47:58 user nova-compute[75000]: No targets found.
Nov 06 22:47:58 user nova-compute[75000]: STATIC:
Nov 06 22:47:58 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c
Nov 06 22:47:58 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:47:58 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:47:58 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab
Nov 06 22:47:58 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:47:58 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:47:58 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c
Nov 06 22:47:58 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:47:58 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:47:58 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e
Nov 06 22:47:58 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:47:58 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:47:58 user nova-compute[75000]: FIRMWARE:
Nov 06 22:47:58 user nova-compute[75000]: No targets found.
Nov 06 22:47:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:47:58 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:47:58 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6e63e2-6701-4630-9b89-c6f070f12a46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d576d013-2b6d-4757-b84a-9a8f295a2d15]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:47:58 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:47:58 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:47:58 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:47:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:47:58 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:47:58 user nova-compute[75000]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e (non-flash)
Nov 06 22:47:58 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:47:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc791d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e'): ({'sde'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Removing single pathed devices sde {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94213063-abec-4e8e-91a2-0020e358572f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f0eca-6903-4714-a17d-0cf3a801b00f]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flushing IO for device /dev/sde {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1598683f-8d79-48d0-a8ad-fb5a51d1520e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f77d6c-70a1-4567-8304-d9090ab5f5ca]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] SCSI volumes sde have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[37639fb2-04fe-468a-91e3-7879b595d8a7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2464e8a-cb67-4f38-ac79-00caa4db9e79]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e, portal: 172.16.0.220,3260]
Nov 06 22:47:58 user nova-compute[75000]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e, portal: 172.16.0.220,3260] successful.
Nov 06 22:47:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ad1462-6917-494d-89a3-e09c1c51579e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[221047ca-03b7-41eb-996b-e2d8886ad78c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== disconnect_volume: return (326ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:47:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquiring lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:47:59 user nova-compute[75000]: INFO nova.compute.claims [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Claim successful on node user
Nov 06 22:47:59 user nova-compute[75000]: DEBUG nova.objects.instance [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-05cae8d2-047a-498f-9c15-93f79d231b77 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.018s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:47:59 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG nova.network.neutron [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:48:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:48:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:48:00 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Creating image(s)
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquiring lock "/opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "/opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "/opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG nova.policy [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd83d252d12cb4563a7a0447ac91ad78c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b307eb0a2b294083a88627727aee461a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.232s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk 1073741824" returned: 0 in 0.055s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:00 user nova-compute[75000]: INFO nova.compute.manager [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Detaching volume 4157946b-2921-42a8-bf47-0d0a3defa1ab
Nov 06 22:48:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:01 user nova-compute[75000]: INFO nova.virt.block_device [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Attempting to driver detach volume 4157946b-2921-42a8-bf47-0d0a3defa1ab from mountpoint /dev/vdc
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Attempting to detach device vdc from instance df39e1c2-a3f5-4133-a101-4a7320987e72 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:48:01 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:48:01 user nova-compute[75000]:   <source dev="/dev/sdf"/>
Nov 06 22:48:01 user nova-compute[75000]:   <target dev="vdc" bus="virtio"/>
Nov 06 22:48:01 user nova-compute[75000]:   <serial>4157946b-2921-42a8-bf47-0d0a3defa1ab</serial>
Nov 06 22:48:01 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 22:48:01 user nova-compute[75000]: </disk>
Nov 06 22:48:01 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:48:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully detached device vdc from instance df39e1c2-a3f5-4133-a101-4a7320987e72 from the persistent domain config.
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance df39e1c2-a3f5-4133-a101-4a7320987e72 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:48:01 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:48:01 user nova-compute[75000]:   <source dev="/dev/sdf"/>
Nov 06 22:48:01 user nova-compute[75000]:   <target dev="vdc" bus="virtio"/>
Nov 06 22:48:01 user nova-compute[75000]:   <serial>4157946b-2921-42a8-bf47-0d0a3defa1ab</serial>
Nov 06 22:48:01 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 22:48:01 user nova-compute[75000]: </disk>
Nov 06 22:48:01 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Successfully created port: 85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Cannot resize image /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Ensure instance console log exists: /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Successfully updated port: 85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquiring lock "refresh_cache-00ccddcc-6045-45df-a5a0-b0ccc54d862e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquired lock "refresh_cache-00ccddcc-6045-45df-a5a0-b0ccc54d862e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-6a4760ff-9bfd-4a0c-b1af-75c9251ce6f1 req-7cc936bb-cb9d-4fe5-8327-7c1989376a97 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received event network-changed-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-6a4760ff-9bfd-4a0c-b1af-75c9251ce6f1 req-7cc936bb-cb9d-4fe5-8327-7c1989376a97 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Refreshing instance network info cache due to event network-changed-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4760ff-9bfd-4a0c-b1af-75c9251ce6f1 req-7cc936bb-cb9d-4fe5-8327-7c1989376a97 service nova] Acquiring lock "refresh_cache-00ccddcc-6045-45df-a5a0-b0ccc54d862e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:48:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Updating instance_info_cache with network_info: [{"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Releasing lock "refresh_cache-00ccddcc-6045-45df-a5a0-b0ccc54d862e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Instance network_info: |[{"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4760ff-9bfd-4a0c-b1af-75c9251ce6f1 req-7cc936bb-cb9d-4fe5-8327-7c1989376a97 service nova] Acquired lock "refresh_cache-00ccddcc-6045-45df-a5a0-b0ccc54d862e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-6a4760ff-9bfd-4a0c-b1af-75c9251ce6f1 req-7cc936bb-cb9d-4fe5-8327-7c1989376a97 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Refreshing network info cache for port 85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Start _get_guest_xml network_info=[{"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:48:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:48:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:47:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1327831413',display_name='tempest-VolumesActionsTest-instance-1327831413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1327831413',id=40,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b307eb0a2b294083a88627727aee461a',ramdisk_id='',reservation_id='r-zpjbvepe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1724063732',owner_user_name='tempest-VolumesActionsTest-1724063732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:48:00Z,user_data=None,user_id='d83d252d12cb4563a7a0447ac91ad78c',uuid=00ccddcc-6045-45df-a5a0-b0ccc54d862e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Converting VIF {"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:37:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1cfd5-87a2-4059-8aff-e0d965d7d5a7,network=Network(73df18fe-fe69-421e-9407-807592801b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1cfd5-87') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.objects.instance [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lazy-loading 'pci_devices' on Instance uuid 00ccddcc-6045-45df-a5a0-b0ccc54d862e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:48:02 user nova-compute[75000]:   <uuid>00ccddcc-6045-45df-a5a0-b0ccc54d862e</uuid>
Nov 06 22:48:02 user nova-compute[75000]:   <name>instance-00000028</name>
Nov 06 22:48:02 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:48:02 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:48:02 user nova-compute[75000]:   <metadata>
Nov 06 22:48:02 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:48:02 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:48:02 user nova-compute[75000]:       <nova:name>tempest-VolumesActionsTest-instance-1327831413</nova:name>
Nov 06 22:48:02 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:48:02</nova:creationTime>
Nov 06 22:48:02 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:48:02 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:48:02 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:48:02 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:48:02 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:48:02 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:48:02 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:48:02 user nova-compute[75000]:       <nova:owner>
Nov 06 22:48:02 user nova-compute[75000]:         <nova:user uuid="d83d252d12cb4563a7a0447ac91ad78c">tempest-VolumesActionsTest-1724063732-project-member</nova:user>
Nov 06 22:48:02 user nova-compute[75000]:         <nova:project uuid="b307eb0a2b294083a88627727aee461a">tempest-VolumesActionsTest-1724063732</nova:project>
Nov 06 22:48:02 user nova-compute[75000]:       </nova:owner>
Nov 06 22:48:02 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:48:02 user nova-compute[75000]:       <nova:ports>
Nov 06 22:48:02 user nova-compute[75000]:         <nova:port uuid="85e1cfd5-87a2-4059-8aff-e0d965d7d5a7">
Nov 06 22:48:02 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 22:48:02 user nova-compute[75000]:         </nova:port>
Nov 06 22:48:02 user nova-compute[75000]:       </nova:ports>
Nov 06 22:48:02 user nova-compute[75000]:     </nova:instance>
Nov 06 22:48:02 user nova-compute[75000]:   </metadata>
Nov 06 22:48:02 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:48:02 user nova-compute[75000]:     <system>
Nov 06 22:48:02 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:48:02 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:48:02 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:48:02 user nova-compute[75000]:       <entry name="serial">00ccddcc-6045-45df-a5a0-b0ccc54d862e</entry>
Nov 06 22:48:02 user nova-compute[75000]:       <entry name="uuid">00ccddcc-6045-45df-a5a0-b0ccc54d862e</entry>
Nov 06 22:48:02 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:48:02 user nova-compute[75000]:     </system>
Nov 06 22:48:02 user nova-compute[75000]:   </sysinfo>
Nov 06 22:48:02 user nova-compute[75000]:   <os>
Nov 06 22:48:02 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:48:02 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:48:02 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:48:02 user nova-compute[75000]:   </os>
Nov 06 22:48:02 user nova-compute[75000]:   <features>
Nov 06 22:48:02 user nova-compute[75000]:     <acpi/>
Nov 06 22:48:02 user nova-compute[75000]:     <apic/>
Nov 06 22:48:02 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:48:02 user nova-compute[75000]:   </features>
Nov 06 22:48:02 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:48:02 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:48:02 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:48:02 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:48:02 user nova-compute[75000]:   </clock>
Nov 06 22:48:02 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:48:02 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:48:02 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:48:02 user nova-compute[75000]:   </cpu>
Nov 06 22:48:02 user nova-compute[75000]:   <devices>
Nov 06 22:48:02 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:48:02 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:48:02 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk"/>
Nov 06 22:48:02 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:48:02 user nova-compute[75000]:     </disk>
Nov 06 22:48:02 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:48:02 user nova-compute[75000]:       <mac address="fa:16:3e:fa:37:32"/>
Nov 06 22:48:02 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:48:02 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:48:02 user nova-compute[75000]:       <target dev="tap85e1cfd5-87"/>
Nov 06 22:48:02 user nova-compute[75000]:     </interface>
Nov 06 22:48:02 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:48:02 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/console.log" append="off"/>
Nov 06 22:48:02 user nova-compute[75000]:     </serial>
Nov 06 22:48:02 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:48:02 user nova-compute[75000]:     <video>
Nov 06 22:48:02 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:48:02 user nova-compute[75000]:     </video>
Nov 06 22:48:02 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:48:02 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:48:02 user nova-compute[75000]:     </rng>
Nov 06 22:48:02 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:48:02 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:48:02 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:48:02 user nova-compute[75000]:     </memballoon>
Nov 06 22:48:02 user nova-compute[75000]:   </devices>
Nov 06 22:48:02 user nova-compute[75000]: </domain>
Nov 06 22:48:02 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:47:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1327831413',display_name='tempest-VolumesActionsTest-instance-1327831413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1327831413',id=40,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b307eb0a2b294083a88627727aee461a',ramdisk_id='',reservation_id='r-zpjbvepe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1724063732',owner_user_name='tempest-VolumesActionsTest-1724063732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:48:00Z,user_data=None,user_id='d83d252d12cb4563a7a0447ac91ad78c',uuid=00ccddcc-6045-45df-a5a0-b0ccc54d862e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Converting VIF {"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:37:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1cfd5-87a2-4059-8aff-e0d965d7d5a7,network=Network(73df18fe-fe69-421e-9407-807592801b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1cfd5-87') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG os_vif [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:37:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1cfd5-87a2-4059-8aff-e0d965d7d5a7,network=Network(73df18fe-fe69-421e-9407-807592801b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1cfd5-87') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68879748-5e44-5e24-a497-a6d571210abf', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85e1cfd5-87, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85e1cfd5-87, col_values=(('qos', UUID('91687bb2-4143-4563-8309-7f80df1fef34')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85e1cfd5-87, col_values=(('external_ids', {'iface-id': '85e1cfd5-87a2-4059-8aff-e0d965d7d5a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:37:32', 'vm-uuid': '00ccddcc-6045-45df-a5a0-b0ccc54d862e'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:02 user nova-compute[75000]: INFO os_vif [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:37:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1cfd5-87a2-4059-8aff-e0d965d7d5a7,network=Network(73df18fe-fe69-421e-9407-807592801b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1cfd5-87')
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] No VIF found with MAC fa:16:3e:fa:37:32, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-6a4760ff-9bfd-4a0c-b1af-75c9251ce6f1 req-7cc936bb-cb9d-4fe5-8327-7c1989376a97 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Updated VIF entry in instance network info cache for port 85e1cfd5-87a2-4059-8aff-e0d965d7d5a7. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-6a4760ff-9bfd-4a0c-b1af-75c9251ce6f1 req-7cc936bb-cb9d-4fe5-8327-7c1989376a97 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Updating instance_info_cache with network_info: [{"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6a4760ff-9bfd-4a0c-b1af-75c9251ce6f1 req-7cc936bb-cb9d-4fe5-8327-7c1989376a97 service nova] Releasing lock "refresh_cache-00ccddcc-6045-45df-a5a0-b0ccc54d862e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:48:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:03 user nova-compute[75000]: DEBUG nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:48:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:03 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:48:03 user nova-compute[75000]: INFO nova.compute.claims [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Claim successful on node user
Nov 06 22:48:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG nova.network.neutron [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:48:04 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:48:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG nova.policy [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40f6f1e5f89e4392ae445be927fd82c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532cabdfcc5f44bb89dd80655c501c60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:48:04 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Creating image(s)
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk 1073741824" returned: 0 in 0.074s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:04 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Successfully created port: c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Cannot resize image /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Ensure instance console log exists: /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Successfully updated port: c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c9fd555-cbb5-4fe4-855b-9e1d6c18374f req-8317b17f-faa6-4eb0-8bf4-12326ae46a99 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-changed-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-2c9fd555-cbb5-4fe4-855b-9e1d6c18374f req-8317b17f-faa6-4eb0-8bf4-12326ae46a99 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Refreshing instance network info cache due to event network-changed-c093b13d-e15d-4272-a9a0-23aa4f229e44. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c9fd555-cbb5-4fe4-855b-9e1d6c18374f req-8317b17f-faa6-4eb0-8bf4-12326ae46a99 service nova] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG nova.network.neutron [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:48:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:48:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Instance spawned successfully.
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Instance network_info: |[{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c9fd555-cbb5-4fe4-855b-9e1d6c18374f req-8317b17f-faa6-4eb0-8bf4-12326ae46a99 service nova] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-2c9fd555-cbb5-4fe4-855b-9e1d6c18374f req-8317b17f-faa6-4eb0-8bf4-12326ae46a99 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Refreshing network info cache for port c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Start _get_guest_xml network_info=[{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:48:06 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:48:06 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1189826598',display_name='tempest-ServerStableDeviceRescueTest-server-1189826598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1189826598',id=41,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORt/xe/qSCDRGFI+7o9IH3tOWYDAW2JZNFvkbb1iGWCHMFgXb10IUNmaEuJ66afGNp1bVppMJMGYR4sJF7amMJ0D3JRACjU8VESaniP/DxVcM9BosmY0u9WRA18TtyuaQ==',key_name='tempest-keypair-805493755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532cabdfcc5f44bb89dd80655c501c60',ramdisk_id='',reservation_id='r-lieke9cv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-457048010',owner_user_name='tempest-ServerStableDeviceRescueTest-457048010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:48:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f6f1e5f89e4392ae445be927fd82c0',uuid=f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Converting VIF {"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=c093b13d-e15d-4272-a9a0-23aa4f229e44,network=Network(d9586576-fa73-42e6-8175-f0e8108b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc093b13d-e1') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.objects.instance [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'pci_devices' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:48:06 user nova-compute[75000]: INFO nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:48:06 user nova-compute[75000]:   <uuid>f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb</uuid>
Nov 06 22:48:06 user nova-compute[75000]:   <name>instance-00000029</name>
Nov 06 22:48:06 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:48:06 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:48:06 user nova-compute[75000]:   <metadata>
Nov 06 22:48:06 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:48:06 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:48:06 user nova-compute[75000]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1189826598</nova:name>
Nov 06 22:48:06 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:48:06</nova:creationTime>
Nov 06 22:48:06 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:48:06 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:48:06 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:48:06 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:48:06 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:48:06 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:48:06 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:48:06 user nova-compute[75000]:       <nova:owner>
Nov 06 22:48:06 user nova-compute[75000]:         <nova:user uuid="40f6f1e5f89e4392ae445be927fd82c0">tempest-ServerStableDeviceRescueTest-457048010-project-member</nova:user>
Nov 06 22:48:06 user nova-compute[75000]:         <nova:project uuid="532cabdfcc5f44bb89dd80655c501c60">tempest-ServerStableDeviceRescueTest-457048010</nova:project>
Nov 06 22:48:06 user nova-compute[75000]:       </nova:owner>
Nov 06 22:48:06 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:48:06 user nova-compute[75000]:       <nova:ports>
Nov 06 22:48:06 user nova-compute[75000]:         <nova:port uuid="c093b13d-e15d-4272-a9a0-23aa4f229e44">
Nov 06 22:48:06 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 22:48:06 user nova-compute[75000]:         </nova:port>
Nov 06 22:48:06 user nova-compute[75000]:       </nova:ports>
Nov 06 22:48:06 user nova-compute[75000]:     </nova:instance>
Nov 06 22:48:06 user nova-compute[75000]:   </metadata>
Nov 06 22:48:06 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:48:06 user nova-compute[75000]:     <system>
Nov 06 22:48:06 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:48:06 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:48:06 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:48:06 user nova-compute[75000]:       <entry name="serial">f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb</entry>
Nov 06 22:48:06 user nova-compute[75000]:       <entry name="uuid">f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb</entry>
Nov 06 22:48:06 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:48:06 user nova-compute[75000]:     </system>
Nov 06 22:48:06 user nova-compute[75000]:   </sysinfo>
Nov 06 22:48:06 user nova-compute[75000]:   <os>
Nov 06 22:48:06 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:48:06 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:48:06 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:48:06 user nova-compute[75000]:   </os>
Nov 06 22:48:06 user nova-compute[75000]:   <features>
Nov 06 22:48:06 user nova-compute[75000]:     <acpi/>
Nov 06 22:48:06 user nova-compute[75000]:     <apic/>
Nov 06 22:48:06 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:48:06 user nova-compute[75000]:   </features>
Nov 06 22:48:06 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:48:06 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:48:06 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:48:06 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:48:06 user nova-compute[75000]:   </clock>
Nov 06 22:48:06 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:48:06 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:48:06 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:48:06 user nova-compute[75000]:   </cpu>
Nov 06 22:48:06 user nova-compute[75000]:   <devices>
Nov 06 22:48:06 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:48:06 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:48:06 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk"/>
Nov 06 22:48:06 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:48:06 user nova-compute[75000]:     </disk>
Nov 06 22:48:06 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:48:06 user nova-compute[75000]:       <mac address="fa:16:3e:69:c3:d6"/>
Nov 06 22:48:06 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:48:06 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:48:06 user nova-compute[75000]:       <target dev="tapc093b13d-e1"/>
Nov 06 22:48:06 user nova-compute[75000]:     </interface>
Nov 06 22:48:06 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:48:06 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/console.log" append="off"/>
Nov 06 22:48:06 user nova-compute[75000]:     </serial>
Nov 06 22:48:06 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:48:06 user nova-compute[75000]:     <video>
Nov 06 22:48:06 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:48:06 user nova-compute[75000]:     </video>
Nov 06 22:48:06 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:48:06 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:48:06 user nova-compute[75000]:     </rng>
Nov 06 22:48:06 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:48:06 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:48:06 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:48:06 user nova-compute[75000]:     </memballoon>
Nov 06 22:48:06 user nova-compute[75000]:   </devices>
Nov 06 22:48:06 user nova-compute[75000]: </domain>
Nov 06 22:48:06 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1189826598',display_name='tempest-ServerStableDeviceRescueTest-server-1189826598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1189826598',id=41,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORt/xe/qSCDRGFI+7o9IH3tOWYDAW2JZNFvkbb1iGWCHMFgXb10IUNmaEuJ66afGNp1bVppMJMGYR4sJF7amMJ0D3JRACjU8VESaniP/DxVcM9BosmY0u9WRA18TtyuaQ==',key_name='tempest-keypair-805493755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532cabdfcc5f44bb89dd80655c501c60',ramdisk_id='',reservation_id='r-lieke9cv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-457048010',owner_user_name='tempest-ServerStableDeviceRescueTest-457048010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:48:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f6f1e5f89e4392ae445be927fd82c0',uuid=f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Converting VIF {"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=c093b13d-e15d-4272-a9a0-23aa4f229e44,network=Network(d9586576-fa73-42e6-8175-f0e8108b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc093b13d-e1') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG os_vif [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=c093b13d-e15d-4272-a9a0-23aa4f229e44,network=Network(d9586576-fa73-42e6-8175-f0e8108b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc093b13d-e1') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04783854-d97d-5557-8ae2-1fbf79964cbd', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc093b13d-e1, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc093b13d-e1, col_values=(('qos', UUID('55ab00e2-2b78-4016-b1dd-4dc294a757c5')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc093b13d-e1, col_values=(('external_ids', {'iface-id': 'c093b13d-e15d-4272-a9a0-23aa4f229e44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:c3:d6', 'vm-uuid': 'f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:06 user nova-compute[75000]: INFO os_vif [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=c093b13d-e15d-4272-a9a0-23aa4f229e44,network=Network(d9586576-fa73-42e6-8175-f0e8108b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc093b13d-e1')
Nov 06 22:48:06 user nova-compute[75000]: INFO nova.compute.manager [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Took 6.66 seconds to build instance.
Nov 06 22:48:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-74f3e19f-6e24-4688-b590-dcbfe6801a1e tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.778s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] No VIF found with MAC fa:16:3e:69:c3:d6, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-2c9fd555-cbb5-4fe4-855b-9e1d6c18374f req-8317b17f-faa6-4eb0-8bf4-12326ae46a99 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updated VIF entry in instance network info cache for port c093b13d-e15d-4272-a9a0-23aa4f229e44. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-2c9fd555-cbb5-4fe4-855b-9e1d6c18374f req-8317b17f-faa6-4eb0-8bf4-12326ae46a99 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2c9fd555-cbb5-4fe4-855b-9e1d6c18374f req-8317b17f-faa6-4eb0-8bf4-12326ae46a99 service nova] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:48:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-3d3c361f-a668-4211-afae-272d485ed04f req-444e204d-db8f-436b-baf4-68e52c214aef service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3d3c361f-a668-4211-afae-272d485ed04f req-444e204d-db8f-436b-baf4-68e52c214aef service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3d3c361f-a668-4211-afae-272d485ed04f req-444e204d-db8f-436b-baf4-68e52c214aef service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3d3c361f-a668-4211-afae-272d485ed04f req-444e204d-db8f-436b-baf4-68e52c214aef service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-3d3c361f-a668-4211-afae-272d485ed04f req-444e204d-db8f-436b-baf4-68e52c214aef service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:08 user nova-compute[75000]: WARNING nova.compute.manager [req-3d3c361f-a668-4211-afae-272d485ed04f req-444e204d-db8f-436b-baf4-68e52c214aef service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state building and task_state spawning.
Nov 06 22:48:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-b6632a99-56f9-4134-bbf9-0dfe19723495 req-146962a6-8b41-4e08-abf1-766f5235a417 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received event network-vif-plugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b6632a99-56f9-4134-bbf9-0dfe19723495 req-146962a6-8b41-4e08-abf1-766f5235a417 service nova] Acquiring lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b6632a99-56f9-4134-bbf9-0dfe19723495 req-146962a6-8b41-4e08-abf1-766f5235a417 service nova] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b6632a99-56f9-4134-bbf9-0dfe19723495 req-146962a6-8b41-4e08-abf1-766f5235a417 service nova] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-b6632a99-56f9-4134-bbf9-0dfe19723495 req-146962a6-8b41-4e08-abf1-766f5235a417 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] No waiting events found dispatching network-vif-plugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:08 user nova-compute[75000]: WARNING nova.compute.manager [req-b6632a99-56f9-4134-bbf9-0dfe19723495 req-146962a6-8b41-4e08-abf1-766f5235a417 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received unexpected event network-vif-plugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 for instance with vm_state active and task_state None.
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:48:10 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Instance spawned successfully.
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-868fff44-628d-484b-a042-4841a0e2a5fd req-7acc1807-d0de-42d1-95dd-280e1c063927 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-868fff44-628d-484b-a042-4841a0e2a5fd req-7acc1807-d0de-42d1-95dd-280e1c063927 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-868fff44-628d-484b-a042-4841a0e2a5fd req-7acc1807-d0de-42d1-95dd-280e1c063927 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-868fff44-628d-484b-a042-4841a0e2a5fd req-7acc1807-d0de-42d1-95dd-280e1c063927 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-868fff44-628d-484b-a042-4841a0e2a5fd req-7acc1807-d0de-42d1-95dd-280e1c063927 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:10 user nova-compute[75000]: WARNING nova.compute.manager [req-868fff44-628d-484b-a042-4841a0e2a5fd req-7acc1807-d0de-42d1-95dd-280e1c063927 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state building and task_state spawning.
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:48:10 user nova-compute[75000]: INFO nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:48:10 user nova-compute[75000]: INFO nova.compute.manager [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Took 6.72 seconds to build instance.
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-102d8958-fd3f-417e-bd52-0c67f6746223 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.931s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-3bfb206b-9ec2-4adf-a44c-eb92aa172cf3 req-b3ef4c79-983f-43eb-8fc6-4c56ff2d768b service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received event network-vif-plugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3bfb206b-9ec2-4adf-a44c-eb92aa172cf3 req-b3ef4c79-983f-43eb-8fc6-4c56ff2d768b service nova] Acquiring lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3bfb206b-9ec2-4adf-a44c-eb92aa172cf3 req-b3ef4c79-983f-43eb-8fc6-4c56ff2d768b service nova] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3bfb206b-9ec2-4adf-a44c-eb92aa172cf3 req-b3ef4c79-983f-43eb-8fc6-4c56ff2d768b service nova] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.compute.manager [req-3bfb206b-9ec2-4adf-a44c-eb92aa172cf3 req-b3ef4c79-983f-43eb-8fc6-4c56ff2d768b service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] No waiting events found dispatching network-vif-plugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:10 user nova-compute[75000]: WARNING nova.compute.manager [req-3bfb206b-9ec2-4adf-a44c-eb92aa172cf3 req-b3ef4c79-983f-43eb-8fc6-4c56ff2d768b service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received unexpected event network-vif-plugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 for instance with vm_state active and task_state None.
Nov 06 22:48:10 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 is timed out.
Nov 06 22:48:10 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Successfully detached device vdb from instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 from the live domain config.
Nov 06 22:48:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbefGyVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:48:10 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1beb255-c002-420d-8e0e-00aa2cda702e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:48:10 user nova-compute[75000]: No targets found.
Nov 06 22:48:10 user nova-compute[75000]: iSNS:
Nov 06 22:48:10 user nova-compute[75000]: No targets found.
Nov 06 22:48:10 user nova-compute[75000]: STATIC:
Nov 06 22:48:10 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c
Nov 06 22:48:10 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:48:10 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:48:10 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab
Nov 06 22:48:10 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:48:10 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:48:10 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c
Nov 06 22:48:10 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:48:10 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:48:10 user nova-compute[75000]: FIRMWARE:
Nov 06 22:48:10 user nova-compute[75000]: No targets found.
Nov 06 22:48:10 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:48:10 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:48:10 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16d601b-a425-4caa-aab5-356b69298ca5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[711ec4fd-bbd5-46f1-a3c0-9d5ab5156fdd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:48:10 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:48:10 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:48:10 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c (non-flash)
Nov 06 22:48:10 user nova-compute[75000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:48:10 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:48:10 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc110dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a7198a-9fb3-4b2e-ab79-833439e4ce45]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[76666d04-20d8-42d7-8c39-e1a450114abf]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38a1725-a333-4c18-b725-c05a0b54cd3f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68fcbc0-9ad2-45aa-84b8-d511742c3f29]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd6f97-72a7-43b6-ae88-06873dc939d5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:48:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7716324-3643-4fa6-a127-ba7bc9d78564]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c, portal: 172.16.0.220,3260]
Nov 06 22:48:11 user nova-compute[75000]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c, portal: 172.16.0.220,3260] successful.
Nov 06 22:48:11 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f01046-6a88-4400-acce-57fc469934c2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] <== disconnect_volume: return (373ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:11 user nova-compute[75000]: INFO nova.compute.manager [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Terminating instance
Nov 06 22:48:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Instance destroyed successfully.
Nov 06 22:48:11 user nova-compute[75000]: DEBUG nova.objects.instance [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lazy-loading 'resources' on Instance uuid 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-543439196',display_name='tempest-SnapshotDataIntegrityTests-server-543439196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-543439196',id=29,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+upLObjkOKNAUZLVX9BKr1a/UzxkWXka2UVRrkECUXvhP8OekoYOL3KnXUGir2rBIA+Xdsz297jDp5miKheavEy30g7F8YbVB5P9W4lp+cunnILKmhox+pVrsjFv8mEw==',key_name='tempest-keypair-1069791076',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:37:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d778f501c55549db895391e5bb73dc26',ramdisk_id='',reservation_id='r-0km79jh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-511259500',owner_user_name='tempest-SnapshotDataIntegrityTests-511259500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c02a9118b9a4e388a81b388169fd773',uuid=0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Converting VIF {"id": "8106fcc8-1c86-4441-8f27-462700afb2f2", "address": "fa:16:3e:a2:a0:8b", "network": {"id": "981d36e9-479b-4d00-b0d0-438b47f0654d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-96881536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d778f501c55549db895391e5bb73dc26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8106fcc8-1c", "ovs_interfaceid": "8106fcc8-1c86-4441-8f27-462700afb2f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8106fcc8-1c86-4441-8f27-462700afb2f2,network=Network(981d36e9-479b-4d00-b0d0-438b47f0654d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8106fcc8-1c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:48:11 user nova-compute[75000]: DEBUG os_vif [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8106fcc8-1c86-4441-8f27-462700afb2f2,network=Network(981d36e9-479b-4d00-b0d0-438b47f0654d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8106fcc8-1c') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8106fcc8-1c, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba2174ab-0190-4fb7-ad55-c6f292c5bf8d) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:12 user nova-compute[75000]: INFO os_vif [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a0:8b,bridge_name='br-int',has_traffic_filtering=True,id=8106fcc8-1c86-4441-8f27-462700afb2f2,network=Network(981d36e9-479b-4d00-b0d0-438b47f0654d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8106fcc8-1c')
Nov 06 22:48:12 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Deleting instance files /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb_del
Nov 06 22:48:12 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Deletion of /opt/stack/data/nova/instances/0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb_del complete
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.objects.instance [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'flavor' on Instance uuid 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received event network-vif-unplugged-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] No waiting events found dispatching network-vif-unplugged-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received event network-vif-unplugged-8106fcc8-1c86-4441-8f27-462700afb2f2 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received event network-vif-plugged-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] Acquiring lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] No waiting events found dispatching network-vif-plugged-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:12 user nova-compute[75000]: WARNING nova.compute.manager [req-8836f5a8-2978-48bd-99c2-fb7af5e8547a req-aa0f53b0-fa57-476c-8861-6416ed81a416 service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received unexpected event network-vif-plugged-8106fcc8-1c86-4441-8f27-462700afb2f2 for instance with vm_state active and task_state deleting.
Nov 06 22:48:12 user nova-compute[75000]: INFO nova.compute.manager [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-ccb35a21-1f55-4be8-9917-55f98825f3ca tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.229s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.099s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:12 user nova-compute[75000]: INFO nova.compute.manager [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Terminating instance
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:12 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Took 0.79 seconds to deallocate network for instance.
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-ff2ac39f-0e6c-44fc-bcc2-0a0c7ac33ca6 req-d03539ff-554c-4f6a-b3d6-9fe0e2091f2c service nova] [instance: 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb] Received event network-vif-deleted-8106fcc8-1c86-4441-8f27-462700afb2f2 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Instance destroyed successfully.
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lazy-loading 'resources' on Instance uuid 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1627674095',display_name='tempest-VolumesSnapshotTestJSON-instance-1627674095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1627674095',id=37,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+L1FwKSCo3s0QAnniUI38+wOonjxvDGgASnGd/GKAXJKDYOdKEVCZIa2eeKATgi53+2iLtVH/14lqFQjgmGPaegnUsHb63MLfTcXRY9PX629LnyN2HPiphX15zjkRIqw==',key_name='tempest-keypair-1311213786',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:44:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c00b052f634d689bfa3e28ffce3d95',ramdisk_id='',reservation_id='r-mdxrnv78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-549753594',owner_user_name='tempest-VolumesSnapshotTestJSON-549753594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:44:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d288b4ec7d714054aefff906d8070a5d',uuid=2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converting VIF {"id": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "address": "fa:16:3e:65:19:c4", "network": {"id": "00c7e1d9-d45a-47bf-a27b-294c308cc1f5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-776163229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c00b052f634d689bfa3e28ffce3d95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape554e8e5-e5", "ovs_interfaceid": "e554e8e5-e5e6-4ff6-a487-b2f37fc616d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=e554e8e5-e5e6-4ff6-a487-b2f37fc616d3,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554e8e5-e5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_vif [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=e554e8e5-e5e6-4ff6-a487-b2f37fc616d3,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554e8e5-e5') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape554e8e5-e5, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b035f176-3b07-40a9-86a9-54d52a19d2bf) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:13 user nova-compute[75000]: INFO os_vif [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=e554e8e5-e5e6-4ff6-a487-b2f37fc616d3,network=Network(00c7e1d9-d45a-47bf-a27b-294c308cc1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape554e8e5-e5')
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbefGyVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:48:13 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c161c11f-e6df-40c7-aa47-b0d7e1140ed4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:48:13 user nova-compute[75000]: No targets found.
Nov 06 22:48:13 user nova-compute[75000]: iSNS:
Nov 06 22:48:13 user nova-compute[75000]: No targets found.
Nov 06 22:48:13 user nova-compute[75000]: STATIC:
Nov 06 22:48:13 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c
Nov 06 22:48:13 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:48:13 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:48:13 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab
Nov 06 22:48:13 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:48:13 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:48:13 user nova-compute[75000]: FIRMWARE:
Nov 06 22:48:13 user nova-compute[75000]: No targets found.
Nov 06 22:48:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:48:13 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:48:13 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45134703-54d2-40ed-8b34-8e59bcd4fd2c', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa60d40d-709b-4a67-a350-3dd728c61876]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47b6661-eca5-47f6-b23d-70ee632d9c43]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:48:13 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:48:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:48:13 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:48:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b8f004c0>, {}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Disconnecting from: [] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.099s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] <== disconnect_volume: return (100ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:48:13 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Deleting instance files /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3_del
Nov 06 22:48:13 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Deletion of /opt/stack/data/nova/instances/2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3_del complete
Nov 06 22:48:13 user nova-compute[75000]: INFO nova.compute.manager [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:13 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Deleted allocations for instance 0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb
Nov 06 22:48:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3ee725f8-4338-403e-a004-b786c6656464 tempest-SnapshotDataIntegrityTests-511259500 tempest-SnapshotDataIntegrityTests-511259500-project-member] Lock "0d4ae20c-87b1-4b2a-ba88-8a06210fe7eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.632s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received event network-vif-unplugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] No waiting events found dispatching network-vif-unplugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received event network-vif-unplugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received event network-vif-plugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] Acquiring lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG nova.compute.manager [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] No waiting events found dispatching network-vif-plugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:14 user nova-compute[75000]: WARNING nova.compute.manager [req-98e33511-97dd-4af9-bda2-126167f57230 req-7165f49c-ae56-49dd-adff-88b24427a341 service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received unexpected event network-vif-plugged-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 for instance with vm_state active and task_state deleting.
Nov 06 22:48:14 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:14 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Took 0.93 seconds to deallocate network for instance.
Nov 06 22:48:14 user nova-compute[75000]: WARNING nova.volume.cinder [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Attachment c510fe3a-07a3-45ff-b3f8-50306472bc32 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c510fe3a-07a3-45ff-b3f8-50306472bc32. (HTTP 404) (Request-ID: req-5ea4f0d8-44ca-4512-92c2-091fdef4a2a5)
Nov 06 22:48:14 user nova-compute[75000]: INFO nova.compute.manager [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Took 0.03 seconds to detach 1 volumes for instance.
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:14 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Deleted allocations for instance 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3
Nov 06 22:48:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c85642a5-3aca-48e8-962a-c7452ed89ddc tempest-VolumesSnapshotTestJSON-549753594 tempest-VolumesSnapshotTestJSON-549753594-project-member] Lock "2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.680s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-8965d50f-d2b5-449f-ae03-c095b90f6bc4 req-01ef98fa-a7f8-42b9-8f6f-b288ee26793e service nova] [instance: 2c6aa2a3-5dbb-49bc-9d2b-08df7fc15cb3] Received event network-vif-deleted-e554e8e5-e5e6-4ff6-a487-b2f37fc616d3 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:17 user nova-compute[75000]: INFO nova.compute.manager [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Terminating instance
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-7b6f2880-f6bb-4cef-9419-4ce0c40b8869 req-023f2863-93f1-41c0-b193-c3bac0b01f03 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7b6f2880-f6bb-4cef-9419-4ce0c40b8869 req-023f2863-93f1-41c0-b193-c3bac0b01f03 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7b6f2880-f6bb-4cef-9419-4ce0c40b8869 req-023f2863-93f1-41c0-b193-c3bac0b01f03 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7b6f2880-f6bb-4cef-9419-4ce0c40b8869 req-023f2863-93f1-41c0-b193-c3bac0b01f03 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-7b6f2880-f6bb-4cef-9419-4ce0c40b8869 req-023f2863-93f1-41c0-b193-c3bac0b01f03 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-7b6f2880-f6bb-4cef-9419-4ce0c40b8869 req-023f2863-93f1-41c0-b193-c3bac0b01f03 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Instance destroyed successfully.
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.objects.instance [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'resources' on Instance uuid f31ab346-0c23-4086-9c16-3322dc972c5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746831654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746831654',id=33,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPxX3LQJMq6tbA/hp/lkqOxna0KLgPcQgngOnf//5bF/+o23OPHaIMGxPh3RSWIaWtgEnV/1dtxkMDXBS8dkft0f4nQOiXD+EFnxP/eLWaTSQIwl2JuGfmafYMiyOjUOg==',key_name='tempest-keypair-1457495529',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-06levmq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:45:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=f31ab346-0c23-4086-9c16-3322dc972c5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "035045a6-0a9c-4787-8776-876c1cb58343", "address": "fa:16:3e:05:5e:74", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035045a6-0a", "ovs_interfaceid": "035045a6-0a9c-4787-8776-876c1cb58343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG os_vif [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap035045a6-0a, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3505b0ba-12f7-41a2-bdcb-7f5189254a8d) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:17 user nova-compute[75000]: INFO os_vif [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:5e:74,bridge_name='br-int',has_traffic_filtering=True,id=035045a6-0a9c-4787-8776-876c1cb58343,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035045a6-0a')
Nov 06 22:48:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Deleting instance files /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f_del
Nov 06 22:48:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Deletion of /opt/stack/data/nova/instances/f31ab346-0c23-4086-9c16-3322dc972c5f_del complete
Nov 06 22:48:17 user nova-compute[75000]: INFO nova.compute.manager [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 06 22:48:17 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:48:17 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:48:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:19 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Took 1.39 seconds to deallocate network for instance.
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:19 user nova-compute[75000]: WARNING nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state deleting.
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:19 user nova-compute[75000]: WARNING nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state deleting.
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:19 user nova-compute[75000]: WARNING nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state deleting.
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-unplugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Acquiring lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] No waiting events found dispatching network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:19 user nova-compute[75000]: WARNING nova.compute.manager [req-59e006a0-7cf0-4e01-b256-e0937ea752ed req-48cf1b7f-d318-47ea-8e1f-4c661a37b5f9 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received unexpected event network-vif-plugged-035045a6-0a9c-4787-8776-876c1cb58343 for instance with vm_state active and task_state deleting.
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-61b0fc60-443d-4735-911d-0ae7cbeb2015 req-7a1542c1-610c-4e69-9590-c2d3b47d1291 service nova] [instance: f31ab346-0c23-4086-9c16-3322dc972c5f] Received event network-vif-deleted-035045a6-0a9c-4787-8776-876c1cb58343 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:48:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:19 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Deleted allocations for instance f31ab346-0c23-4086-9c16-3322dc972c5f
Nov 06 22:48:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1bac406f-ac0a-4200-bae1-7fe7dc10bef8 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "f31ab346-0c23-4086-9c16-3322dc972c5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.093s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-57d3728c-789a-4412-9602-65c0176a437e req-82ec83a2-29b2-4019-a255-654f1f5fd7e5 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received event network-changed-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-57d3728c-789a-4412-9602-65c0176a437e req-82ec83a2-29b2-4019-a255-654f1f5fd7e5 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Refreshing instance network info cache due to event network-changed-ffa643ce-ec44-4d3d-be6e-766df9e123fc. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-57d3728c-789a-4412-9602-65c0176a437e req-82ec83a2-29b2-4019-a255-654f1f5fd7e5 service nova] Acquiring lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-57d3728c-789a-4412-9602-65c0176a437e req-82ec83a2-29b2-4019-a255-654f1f5fd7e5 service nova] Acquired lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG nova.network.neutron [req-57d3728c-789a-4412-9602-65c0176a437e req-82ec83a2-29b2-4019-a255-654f1f5fd7e5 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Refreshing network info cache for port ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:48:21 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance df39e1c2-a3f5-4133-a101-4a7320987e72 is timed out.
Nov 06 22:48:21 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully detached device vdc from instance df39e1c2-a3f5-4133-a101-4a7320987e72 from the live domain config.
Nov 06 22:48:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BCfOYjnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:48:21 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8006f749-4d73-4f3b-87e4-8473e533b924]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:48:21 user nova-compute[75000]: No targets found.
Nov 06 22:48:21 user nova-compute[75000]: iSNS:
Nov 06 22:48:21 user nova-compute[75000]: No targets found.
Nov 06 22:48:21 user nova-compute[75000]: STATIC:
Nov 06 22:48:21 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c
Nov 06 22:48:21 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:48:21 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:48:21 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab
Nov 06 22:48:21 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:48:21 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:48:21 user nova-compute[75000]: FIRMWARE:
Nov 06 22:48:21 user nova-compute[75000]: No targets found.
Nov 06 22:48:21 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:48:21 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:48:21 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b542891-1b2d-4c78-8385-dcb761300986]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[61210373-64bb-4a63-b087-082923bbaedb]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:48:21 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:48:21 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:48:21 user nova-compute[75000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab (non-flash)
Nov 06 22:48:21 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b8f03a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab'): ({'sdf'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Removing single pathed devices sdf {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f55e414-dcd5-43d0-aebf-27f20105b3e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c9f0a3-06d9-4fe8-835e-2c3bc83bb7a3]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Flushing IO for device /dev/sdf {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f45feb-b5dc-4ab8-9f53-571f04d31e72]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b349c94f-4542-4a58-ad7f-0f792d0b2ce9]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] SCSI volumes sdf have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8696cd99-8f7a-4228-9eb5-09ade89fd5bb]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e7e2d2-f4a3-44a9-91fa-f7e295ef9268]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab, portal: 172.16.0.220,3260]
Nov 06 22:48:21 user nova-compute[75000]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab, portal: 172.16.0.220,3260] successful.
Nov 06 22:48:21 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4157946b-2921-42a8-bf47-0d0a3defa1ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[486fe8d0-5c9c-47ce-b61d-d238fe4b924f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] <== disconnect_volume: return (330ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:48:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:48:22 user nova-compute[75000]: DEBUG nova.network.neutron [req-57d3728c-789a-4412-9602-65c0176a437e req-82ec83a2-29b2-4019-a255-654f1f5fd7e5 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updated VIF entry in instance network info cache for port ffa643ce-ec44-4d3d-be6e-766df9e123fc. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:48:22 user nova-compute[75000]: DEBUG nova.network.neutron [req-57d3728c-789a-4412-9602-65c0176a437e req-82ec83a2-29b2-4019-a255-654f1f5fd7e5 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updating instance_info_cache with network_info: [{"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-57d3728c-789a-4412-9602-65c0176a437e req-82ec83a2-29b2-4019-a255-654f1f5fd7e5 service nova] Releasing lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:48:22 user nova-compute[75000]: DEBUG nova.objects.instance [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'flavor' on Instance uuid df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:48:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5121bc59-3d6b-486d-b227-35901f9953b7 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.922s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:24 user nova-compute[75000]: INFO nova.compute.manager [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Terminating instance
Nov 06 22:48:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-ce3cd729-f261-44eb-a8aa-524d64db8dfc req-67912423-879c-4b13-b2a6-9ce8cc2aecef service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received event network-vif-unplugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce3cd729-f261-44eb-a8aa-524d64db8dfc req-67912423-879c-4b13-b2a6-9ce8cc2aecef service nova] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce3cd729-f261-44eb-a8aa-524d64db8dfc req-67912423-879c-4b13-b2a6-9ce8cc2aecef service nova] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ce3cd729-f261-44eb-a8aa-524d64db8dfc req-67912423-879c-4b13-b2a6-9ce8cc2aecef service nova] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-ce3cd729-f261-44eb-a8aa-524d64db8dfc req-67912423-879c-4b13-b2a6-9ce8cc2aecef service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] No waiting events found dispatching network-vif-unplugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-ce3cd729-f261-44eb-a8aa-524d64db8dfc req-67912423-879c-4b13-b2a6-9ce8cc2aecef service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received event network-vif-unplugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:48:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Instance destroyed successfully.
Nov 06 22:48:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lazy-loading 'resources' on Instance uuid df39e1c2-a3f5-4133-a101-4a7320987e72 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1598449580',display_name='tempest-AttachVolumeTestJSON-server-1598449580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1598449580',id=36,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYyU+BsuyGlPdSHdD8qCv7Q/U5LOwBOGo1rM6Qb03ZlbOhLH3LWxt1tY1YzUeSlWuSY3feFSF91KNzhNMIptGFdAHHAuZrRneNrSMRT+SRGF4Ed46RNVwQVh0bNn18lhA==',key_name='tempest-keypair-841911276',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='425b4940d7904d58982aae5a883fc3ed',ramdisk_id='',reservation_id='r-b4px2meq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738638018',owner_user_name='tempest-AttachVolumeTestJSON-738638018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9adf42a2f6ae4b83900ab310933a6421',uuid=df39e1c2-a3f5-4133-a101-4a7320987e72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converting VIF {"id": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "address": "fa:16:3e:f1:14:63", "network": {"id": "93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-223139897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "425b4940d7904d58982aae5a883fc3ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed826c4-22", "ovs_interfaceid": "0ed826c4-2272-40f7-80a4-f8d4006cd042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:14:63,bridge_name='br-int',has_traffic_filtering=True,id=0ed826c4-2272-40f7-80a4-f8d4006cd042,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed826c4-22') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG os_vif [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:14:63,bridge_name='br-int',has_traffic_filtering=True,id=0ed826c4-2272-40f7-80a4-f8d4006cd042,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed826c4-22') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ed826c4-22, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9862a0c-20d2-4b72-82d9-644b5c397c76) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:25 user nova-compute[75000]: INFO os_vif [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:14:63,bridge_name='br-int',has_traffic_filtering=True,id=0ed826c4-2272-40f7-80a4-f8d4006cd042,network=Network(93c7cdb1-2f5f-4e90-a68a-1d49ab8d62b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed826c4-22')
Nov 06 22:48:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Deleting instance files /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72_del
Nov 06 22:48:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Deletion of /opt/stack/data/nova/instances/df39e1c2-a3f5-4133-a101-4a7320987e72_del complete
Nov 06 22:48:25 user nova-compute[75000]: INFO nova.compute.manager [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 06 22:48:25 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:48:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:26 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Took 0.83 seconds to deallocate network for instance.
Nov 06 22:48:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4c2bacb-d228-4267-b295-9e957b73f56d req-8ba41aa7-5077-4e1e-8824-c3f12be06911 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received event network-vif-deleted-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:26 user nova-compute[75000]: INFO nova.compute.manager [req-d4c2bacb-d228-4267-b295-9e957b73f56d req-8ba41aa7-5077-4e1e-8824-c3f12be06911 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Neutron deleted interface 0ed826c4-2272-40f7-80a4-f8d4006cd042; detaching it from the instance and deleting it from the info cache
Nov 06 22:48:26 user nova-compute[75000]: DEBUG nova.network.neutron [req-d4c2bacb-d228-4267-b295-9e957b73f56d req-8ba41aa7-5077-4e1e-8824-c3f12be06911 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-d4c2bacb-d228-4267-b295-9e957b73f56d req-8ba41aa7-5077-4e1e-8824-c3f12be06911 service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Detach interface failed, port_id=0ed826c4-2272-40f7-80a4-f8d4006cd042, reason: Instance df39e1c2-a3f5-4133-a101-4a7320987e72 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:26 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Deleted allocations for instance df39e1c2-a3f5-4133-a101-4a7320987e72
Nov 06 22:48:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c8f8a757-ef7f-4eaf-918e-dbdd2f602fa1 tempest-AttachVolumeTestJSON-738638018 tempest-AttachVolumeTestJSON-738638018-project-member] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-a58cddb5-fa49-4922-a1d0-dffa760dfa6e req-71c88231-3191-407d-87c4-4c6ffa2231dd service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received event network-vif-plugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a58cddb5-fa49-4922-a1d0-dffa760dfa6e req-71c88231-3191-407d-87c4-4c6ffa2231dd service nova] Acquiring lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a58cddb5-fa49-4922-a1d0-dffa760dfa6e req-71c88231-3191-407d-87c4-4c6ffa2231dd service nova] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a58cddb5-fa49-4922-a1d0-dffa760dfa6e req-71c88231-3191-407d-87c4-4c6ffa2231dd service nova] Lock "df39e1c2-a3f5-4133-a101-4a7320987e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-a58cddb5-fa49-4922-a1d0-dffa760dfa6e req-71c88231-3191-407d-87c4-4c6ffa2231dd service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] No waiting events found dispatching network-vif-plugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:48:26 user nova-compute[75000]: WARNING nova.compute.manager [req-a58cddb5-fa49-4922-a1d0-dffa760dfa6e req-71c88231-3191-407d-87c4-4c6ffa2231dd service nova] [instance: df39e1c2-a3f5-4133-a101-4a7320987e72] Received unexpected event network-vif-plugged-0ed826c4-2272-40f7-80a4-f8d4006cd042 for instance with vm_state deleted and task_state None.
Nov 06 22:48:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "d6faab59-7d75-41a0-961e-1b9566b0afe5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:48:35 user nova-compute[75000]: INFO nova.compute.claims [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Claim successful on node user
Nov 06 22:48:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:48:35 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:48:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:48:35 user nova-compute[75000]: INFO nova.virt.block_device [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Booting with volume snapshot f0a38b35-ce68-47ab-867b-9d0a31e93958 at /dev/vda
Nov 06 22:48:35 user nova-compute[75000]: DEBUG nova.policy [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d4aa96179fd4121ba224f47c01d9364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828fc01bb744496f83bd0f5d90e6924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:48:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:36 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Successfully created port: 1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Successfully updated port: 1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "refresh_cache-d6faab59-7d75-41a0-961e-1b9566b0afe5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquired lock "refresh_cache-d6faab59-7d75-41a0-961e-1b9566b0afe5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-5da9405f-0ad1-42aa-b9d4-af4bc65518ac req-a83a35c7-b5f3-43bd-8a9e-84364f764241 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received event network-changed-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-5da9405f-0ad1-42aa-b9d4-af4bc65518ac req-a83a35c7-b5f3-43bd-8a9e-84364f764241 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Refreshing instance network info cache due to event network-changed-1bd5c557-7eec-4aec-a57f-128e07e29320. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5da9405f-0ad1-42aa-b9d4-af4bc65518ac req-a83a35c7-b5f3-43bd-8a9e-84364f764241 service nova] Acquiring lock "refresh_cache-d6faab59-7d75-41a0-961e-1b9566b0afe5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Updating instance_info_cache with network_info: [{"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Releasing lock "refresh_cache-d6faab59-7d75-41a0-961e-1b9566b0afe5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Instance network_info: |[{"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5da9405f-0ad1-42aa-b9d4-af4bc65518ac req-a83a35c7-b5f3-43bd-8a9e-84364f764241 service nova] Acquired lock "refresh_cache-d6faab59-7d75-41a0-961e-1b9566b0afe5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.network.neutron [req-5da9405f-0ad1-42aa-b9d4-af4bc65518ac req-a83a35c7-b5f3-43bd-8a9e-84364f764241 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Refreshing network info cache for port 1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.network.neutron [req-5da9405f-0ad1-42aa-b9d4-af4bc65518ac req-a83a35c7-b5f3-43bd-8a9e-84364f764241 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Updated VIF entry in instance network info cache for port 1bd5c557-7eec-4aec-a57f-128e07e29320. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG nova.network.neutron [req-5da9405f-0ad1-42aa-b9d4-af4bc65518ac req-a83a35c7-b5f3-43bd-8a9e-84364f764241 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Updating instance_info_cache with network_info: [{"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5da9405f-0ad1-42aa-b9d4-af4bc65518ac req-a83a35c7-b5f3-43bd-8a9e-84364f764241 service nova] Releasing lock "refresh_cache-d6faab59-7d75-41a0-961e-1b9566b0afe5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:48:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG os_brick.utils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8799b170-92f2-454b-a49d-564e1a228b4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47c1325-56cb-4c11-b0e1-c269442ae273]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f21493-e5b0-4995-801a-5233729e7c44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eec40d-f646-46fc-b8df-b20d6c00fee0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:48:41 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b4d660-8e08-41fb-afd6-c07f1f51a7ab]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG os_brick.utils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Updating existing volume attachment record: 421337da-4b42-43cd-8288-b1e6b2017eca {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:42 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:48:42 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:48:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8112MB free_disk=25.153854370117188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 00ccddcc-6045-45df-a5a0-b0ccc54d862e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d6faab59-7d75-41a0-961e-1b9566b0afe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:48:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:48:43 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:48:43 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:48:43 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:48:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:48:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:48:44 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:48:44 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 22:48:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:48:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:48:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:48:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:48:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:48:47 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:48:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:48:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:48:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-8a21fb2f-df51-46bf-a357-460d259eddc6 req-359f4307-59da-44c9-a258-e0c01451e0aa service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received event network-changed-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:48:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-8a21fb2f-df51-46bf-a357-460d259eddc6 req-359f4307-59da-44c9-a258-e0c01451e0aa service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Refreshing instance network info cache due to event network-changed-fb7843bb-4d08-4a40-843c-ff217cfa0561. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:48:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8a21fb2f-df51-46bf-a357-460d259eddc6 req-359f4307-59da-44c9-a258-e0c01451e0aa service nova] Acquiring lock "refresh_cache-ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:48:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8a21fb2f-df51-46bf-a357-460d259eddc6 req-359f4307-59da-44c9-a258-e0c01451e0aa service nova] Acquired lock "refresh_cache-ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:48:51 user nova-compute[75000]: DEBUG nova.network.neutron [req-8a21fb2f-df51-46bf-a357-460d259eddc6 req-359f4307-59da-44c9-a258-e0c01451e0aa service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Refreshing network info cache for port fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:48:52 user nova-compute[75000]: DEBUG nova.network.neutron [req-8a21fb2f-df51-46bf-a357-460d259eddc6 req-359f4307-59da-44c9-a258-e0c01451e0aa service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Updated VIF entry in instance network info cache for port fb7843bb-4d08-4a40-843c-ff217cfa0561. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:48:52 user nova-compute[75000]: DEBUG nova.network.neutron [req-8a21fb2f-df51-46bf-a357-460d259eddc6 req-359f4307-59da-44c9-a258-e0c01451e0aa service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Updating instance_info_cache with network_info: [{"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:48:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8a21fb2f-df51-46bf-a357-460d259eddc6 req-359f4307-59da-44c9-a258-e0c01451e0aa service nova] Releasing lock "refresh_cache-ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:48:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:48:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'flavor' on Instance uuid ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:48:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:48:58 user nova-compute[75000]: INFO nova.compute.manager [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Attaching volume 3a96564e-1f8e-4de2-a794-d71f70184991 to /dev/vdb
Nov 06 22:48:58 user nova-compute[75000]: DEBUG os_brick.utils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1003a7-ff90-4bf0-902b-392e70af917c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8aec72-055f-4323-9e09-48f96bb0e954]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[380026b0-6365-4aab-86d8-8970092816a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de5a5b-af44-4cac-acaa-1a2ce14450d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:48:58 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:48:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83d46d0-71a9-4f98-968c-7de02f0ae526]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG os_brick.utils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:48:58 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Updating existing volume attachment record: 29600f83-9907-4caf-88cf-72edca28ba32 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:49:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:49:11 user nova-compute[75000]: INFO nova.compute.claims [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Claim successful on node user
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.network.neutron [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:49:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.policy [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27639ab7ae064eca9e2c1b23ded8a866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9412d5020f342499289d8ad48e19ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:49:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Creating image(s)
Nov 06 22:49:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.134s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk 1073741824" returned: 0 in 0.065s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Successfully created port: e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Cannot resize image /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Ensure instance console log exists: /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Successfully updated port: e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquired lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG nova.network.neutron [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-deb75a7f-f540-47ee-a70b-eef70ed8692b req-0f67eef3-2707-4489-ad63-97cdb2f78d72 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-changed-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG nova.compute.manager [req-deb75a7f-f540-47ee-a70b-eef70ed8692b req-0f67eef3-2707-4489-ad63-97cdb2f78d72 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Refreshing instance network info cache due to event network-changed-e9674a8f-d7bf-4285-8b50-d537e1950f5a. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:49:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-deb75a7f-f540-47ee-a70b-eef70ed8692b req-0f67eef3-2707-4489-ad63-97cdb2f78d72 service nova] Acquiring lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.network.neutron [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.network.neutron [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updating instance_info_cache with network_info: [{"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Releasing lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance network_info: |[{"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-deb75a7f-f540-47ee-a70b-eef70ed8692b req-0f67eef3-2707-4489-ad63-97cdb2f78d72 service nova] Acquired lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.network.neutron [req-deb75a7f-f540-47ee-a70b-eef70ed8692b req-0f67eef3-2707-4489-ad63-97cdb2f78d72 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Refreshing network info cache for port e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Start _get_guest_xml network_info=[{"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:49:13 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:49:13 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-209577925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-209577925',id=43,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrES4qw0nR1lLXFRqevIQMp6bQWTTgmS5ngDzksjryuVEm4Ftg62UKG9Dhb6PlTaUhAGsmLa10P1f5VwBxliCoe1FTmxoBR6fUQ4nIsI31j5LQqMd10peGauFL4yr2Z6w==',key_name='tempest-keypair-1151415361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-ea9l078y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=b04a54d9-a6c5-46a3-a709-929cf86a59e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.objects.instance [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'pci_devices' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:49:13 user nova-compute[75000]:   <uuid>b04a54d9-a6c5-46a3-a709-929cf86a59e3</uuid>
Nov 06 22:49:13 user nova-compute[75000]:   <name>instance-0000002b</name>
Nov 06 22:49:13 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:49:13 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:49:13 user nova-compute[75000]:   <metadata>
Nov 06 22:49:13 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:49:13 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:49:13 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-209577925</nova:name>
Nov 06 22:49:13 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:49:13</nova:creationTime>
Nov 06 22:49:13 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:49:13 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:49:13 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:49:13 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:49:13 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:49:13 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:49:13 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:49:13 user nova-compute[75000]:       <nova:owner>
Nov 06 22:49:13 user nova-compute[75000]:         <nova:user uuid="27639ab7ae064eca9e2c1b23ded8a866">tempest-AttachVolumeShelveTestJSON-346837560-project-member</nova:user>
Nov 06 22:49:13 user nova-compute[75000]:         <nova:project uuid="e9412d5020f342499289d8ad48e19ac4">tempest-AttachVolumeShelveTestJSON-346837560</nova:project>
Nov 06 22:49:13 user nova-compute[75000]:       </nova:owner>
Nov 06 22:49:13 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:49:13 user nova-compute[75000]:       <nova:ports>
Nov 06 22:49:13 user nova-compute[75000]:         <nova:port uuid="e9674a8f-d7bf-4285-8b50-d537e1950f5a">
Nov 06 22:49:13 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 22:49:13 user nova-compute[75000]:         </nova:port>
Nov 06 22:49:13 user nova-compute[75000]:       </nova:ports>
Nov 06 22:49:13 user nova-compute[75000]:     </nova:instance>
Nov 06 22:49:13 user nova-compute[75000]:   </metadata>
Nov 06 22:49:13 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:49:13 user nova-compute[75000]:     <system>
Nov 06 22:49:13 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:49:13 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:49:13 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:49:13 user nova-compute[75000]:       <entry name="serial">b04a54d9-a6c5-46a3-a709-929cf86a59e3</entry>
Nov 06 22:49:13 user nova-compute[75000]:       <entry name="uuid">b04a54d9-a6c5-46a3-a709-929cf86a59e3</entry>
Nov 06 22:49:13 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:49:13 user nova-compute[75000]:     </system>
Nov 06 22:49:13 user nova-compute[75000]:   </sysinfo>
Nov 06 22:49:13 user nova-compute[75000]:   <os>
Nov 06 22:49:13 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:49:13 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:49:13 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:49:13 user nova-compute[75000]:   </os>
Nov 06 22:49:13 user nova-compute[75000]:   <features>
Nov 06 22:49:13 user nova-compute[75000]:     <acpi/>
Nov 06 22:49:13 user nova-compute[75000]:     <apic/>
Nov 06 22:49:13 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:49:13 user nova-compute[75000]:   </features>
Nov 06 22:49:13 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:49:13 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:49:13 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:49:13 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:49:13 user nova-compute[75000]:   </clock>
Nov 06 22:49:13 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:49:13 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:49:13 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:49:13 user nova-compute[75000]:   </cpu>
Nov 06 22:49:13 user nova-compute[75000]:   <devices>
Nov 06 22:49:13 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:49:13 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:49:13 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk"/>
Nov 06 22:49:13 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:49:13 user nova-compute[75000]:     </disk>
Nov 06 22:49:13 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:49:13 user nova-compute[75000]:       <mac address="fa:16:3e:c8:99:dc"/>
Nov 06 22:49:13 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:49:13 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:49:13 user nova-compute[75000]:       <target dev="tape9674a8f-d7"/>
Nov 06 22:49:13 user nova-compute[75000]:     </interface>
Nov 06 22:49:13 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:49:13 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/console.log" append="off"/>
Nov 06 22:49:13 user nova-compute[75000]:     </serial>
Nov 06 22:49:13 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:49:13 user nova-compute[75000]:     <video>
Nov 06 22:49:13 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:49:13 user nova-compute[75000]:     </video>
Nov 06 22:49:13 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:49:13 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:49:13 user nova-compute[75000]:     </rng>
Nov 06 22:49:13 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:49:13 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:49:13 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:49:13 user nova-compute[75000]:     </memballoon>
Nov 06 22:49:13 user nova-compute[75000]:   </devices>
Nov 06 22:49:13 user nova-compute[75000]: </domain>
Nov 06 22:49:13 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-209577925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-209577925',id=43,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrES4qw0nR1lLXFRqevIQMp6bQWTTgmS5ngDzksjryuVEm4Ftg62UKG9Dhb6PlTaUhAGsmLa10P1f5VwBxliCoe1FTmxoBR6fUQ4nIsI31j5LQqMd10peGauFL4yr2Z6w==',key_name='tempest-keypair-1151415361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-ea9l078y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=b04a54d9-a6c5-46a3-a709-929cf86a59e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG os_vif [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b805f5bc-421a-5848-8744-c786c55b3253', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9674a8f-d7, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9674a8f-d7, col_values=(('qos', UUID('dc31acde-8035-4e7e-bde1-aa42c6955418')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9674a8f-d7, col_values=(('external_ids', {'iface-id': 'e9674a8f-d7bf-4285-8b50-d537e1950f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:99:dc', 'vm-uuid': 'b04a54d9-a6c5-46a3-a709-929cf86a59e3'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:13 user nova-compute[75000]: INFO os_vif [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7')
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] No VIF found with MAC fa:16:3e:c8:99:dc, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.network.neutron [req-deb75a7f-f540-47ee-a70b-eef70ed8692b req-0f67eef3-2707-4489-ad63-97cdb2f78d72 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updated VIF entry in instance network info cache for port e9674a8f-d7bf-4285-8b50-d537e1950f5a. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG nova.network.neutron [req-deb75a7f-f540-47ee-a70b-eef70ed8692b req-0f67eef3-2707-4489-ad63-97cdb2f78d72 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updating instance_info_cache with network_info: [{"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:49:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-deb75a7f-f540-47ee-a70b-eef70ed8692b req-0f67eef3-2707-4489-ad63-97cdb2f78d72 service nova] Releasing lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:49:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-28aba034-3dc3-4463-8ec8-4495c81baa1b req-7cff15a3-0fc9-48b2-9d41-c3c727b19d16 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:49:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-28aba034-3dc3-4463-8ec8-4495c81baa1b req-7cff15a3-0fc9-48b2-9d41-c3c727b19d16 service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-28aba034-3dc3-4463-8ec8-4495c81baa1b req-7cff15a3-0fc9-48b2-9d41-c3c727b19d16 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-28aba034-3dc3-4463-8ec8-4495c81baa1b req-7cff15a3-0fc9-48b2-9d41-c3c727b19d16 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-28aba034-3dc3-4463-8ec8-4495c81baa1b req-7cff15a3-0fc9-48b2-9d41-c3c727b19d16 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:49:15 user nova-compute[75000]: WARNING nova.compute.manager [req-28aba034-3dc3-4463-8ec8-4495c81baa1b req-7cff15a3-0fc9-48b2-9d41-c3c727b19d16 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state building and task_state spawning.
Nov 06 22:49:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-6f3bfd59-bd06-4022-b15d-9a5ff5e7718a req-1f0aaf70-ea65-4437-ae56-160ec4e85dd7 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6f3bfd59-bd06-4022-b15d-9a5ff5e7718a req-1f0aaf70-ea65-4437-ae56-160ec4e85dd7 service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6f3bfd59-bd06-4022-b15d-9a5ff5e7718a req-1f0aaf70-ea65-4437-ae56-160ec4e85dd7 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6f3bfd59-bd06-4022-b15d-9a5ff5e7718a req-1f0aaf70-ea65-4437-ae56-160ec4e85dd7 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-6f3bfd59-bd06-4022-b15d-9a5ff5e7718a req-1f0aaf70-ea65-4437-ae56-160ec4e85dd7 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:49:17 user nova-compute[75000]: WARNING nova.compute.manager [req-6f3bfd59-bd06-4022-b15d-9a5ff5e7718a req-1f0aaf70-ea65-4437-ae56-160ec4e85dd7 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state building and task_state spawning.
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:49:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance spawned successfully.
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:49:17 user nova-compute[75000]: INFO nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 06 22:49:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:49:17 user nova-compute[75000]: INFO nova.compute.manager [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Took 6.16 seconds to build instance.
Nov 06 22:49:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-524bd89b-ecad-4719-8ff6-18d20f790622 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.292s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:49:37 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Creating image(s)
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Ensure instance console log exists: /opt/stack/data/nova/instances/d6faab59-7d75-41a0-961e-1b9566b0afe5/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Start _get_guest_xml network_info=[{"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-06T22:48:21Z,direct_url=<?>,disk_format='qcow2',id=fb4ac28a-ac37-4a0b-bbaf-cd11b5d9cb6d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1085060578',owner='828fc01bb744496f83bd0f5d90e6924f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-06T22:48:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyxkSpaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6faab59-7d75-41a0-961e-1b9566b0afe5', 'attached_at': '', 'detached_at': '', 'volume_id': '3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb', 'serial': '3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb'}, 'attachment_id': '421337da-4b42-43cd-8288-b1e6b2017eca', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:49:37 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:49:37 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-06T22:48:21Z,direct_url=<?>,disk_format='qcow2',id=fb4ac28a-ac37-4a0b-bbaf-cd11b5d9cb6d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1085060578',owner='828fc01bb744496f83bd0f5d90e6924f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-06T22:48:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyxkSpaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:49:37 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:49:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:49:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:49:37 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:49:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:49:38 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd0ecb3-2973-40f1-8b48-50e0f6acd744]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:49:38 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8442eff6-e849-4d0e-ae49-0124607437a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb] added
Nov 06 22:49:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2310bcb1-34ee-4e6a-9a62-c105a4586059]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a332a8-dd4c-4e19-b386-1e584051016a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyxkSpaV {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyxkSpaV" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2478c48f-7b7a-497a-895a-3c77f1279570]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fyxkSpaV'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc01b6bb-11b8-4433-8388-5b1777947f27]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3283441-8657-47d4-ab49-f8a4ecff5e9e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:49:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:49:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8626f6ae-3223-4763-bfad-cad73c1de496]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb, portal: 172.16.0.220,3260]
Nov 06 22:49:38 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb, portal: 172.16.0.220,3260] successful.
Nov 06 22:49:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0811137b-7205-4462-be54-a21e6450064b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ed16b4-6eeb-488c-a0d1-c9d6455688e5]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:49:38 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:49:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:49:38 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:49:38 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87fd36b-47e4-4074-bfb5-6f810ae975f4]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyxkSpaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:49:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26236336462326538', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236336462326538', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:48:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1520061310',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1520061310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1520061310',id=42,image_ref='fb4ac28a-ac37-4a0b-bbaf-cd11b5d9cb6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0lxEYtUNz36scr2uqiJge/tq+1bXkIaJboDZYdybrePrJzUf03EVh4PWeUe6WgPjEDu+/tRgpCDQkWJRUYlecjCtYJhxa/aHwyMxSyzugEBgbAZi6S+KCZRcDw5p9lNA==',key_name='tempest-keypair-871998994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-w5c1cn4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-673062967',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:48:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=d6faab59-7d75-41a0-961e-1b9566b0afe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:72,bridge_name='br-int',has_traffic_filtering=True,id=1bd5c557-7eec-4aec-a57f-128e07e29320,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd5c557-7e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'pci_devices' on Instance uuid d6faab59-7d75-41a0-961e-1b9566b0afe5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:49:39 user nova-compute[75000]:   <uuid>d6faab59-7d75-41a0-961e-1b9566b0afe5</uuid>
Nov 06 22:49:39 user nova-compute[75000]:   <name>instance-0000002a</name>
Nov 06 22:49:39 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:49:39 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:49:39 user nova-compute[75000]:   <metadata>
Nov 06 22:49:39 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:49:39 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:49:39 user nova-compute[75000]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1520061310</nova:name>
Nov 06 22:49:39 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:49:37</nova:creationTime>
Nov 06 22:49:39 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:49:39 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:49:39 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:49:39 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:49:39 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:49:39 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:49:39 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:49:39 user nova-compute[75000]:       <nova:owner>
Nov 06 22:49:39 user nova-compute[75000]:         <nova:user uuid="0d4aa96179fd4121ba224f47c01d9364">tempest-TestVolumeBootPattern-673062967-project-member</nova:user>
Nov 06 22:49:39 user nova-compute[75000]:         <nova:project uuid="828fc01bb744496f83bd0f5d90e6924f">tempest-TestVolumeBootPattern-673062967</nova:project>
Nov 06 22:49:39 user nova-compute[75000]:       </nova:owner>
Nov 06 22:49:39 user nova-compute[75000]:       <nova:root type="image" uuid="fb4ac28a-ac37-4a0b-bbaf-cd11b5d9cb6d"/>
Nov 06 22:49:39 user nova-compute[75000]:       <nova:ports>
Nov 06 22:49:39 user nova-compute[75000]:         <nova:port uuid="1bd5c557-7eec-4aec-a57f-128e07e29320">
Nov 06 22:49:39 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 22:49:39 user nova-compute[75000]:         </nova:port>
Nov 06 22:49:39 user nova-compute[75000]:       </nova:ports>
Nov 06 22:49:39 user nova-compute[75000]:     </nova:instance>
Nov 06 22:49:39 user nova-compute[75000]:   </metadata>
Nov 06 22:49:39 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:49:39 user nova-compute[75000]:     <system>
Nov 06 22:49:39 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:49:39 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:49:39 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:49:39 user nova-compute[75000]:       <entry name="serial">d6faab59-7d75-41a0-961e-1b9566b0afe5</entry>
Nov 06 22:49:39 user nova-compute[75000]:       <entry name="uuid">d6faab59-7d75-41a0-961e-1b9566b0afe5</entry>
Nov 06 22:49:39 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:49:39 user nova-compute[75000]:     </system>
Nov 06 22:49:39 user nova-compute[75000]:   </sysinfo>
Nov 06 22:49:39 user nova-compute[75000]:   <os>
Nov 06 22:49:39 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:49:39 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:49:39 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:49:39 user nova-compute[75000]:   </os>
Nov 06 22:49:39 user nova-compute[75000]:   <features>
Nov 06 22:49:39 user nova-compute[75000]:     <acpi/>
Nov 06 22:49:39 user nova-compute[75000]:     <apic/>
Nov 06 22:49:39 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:49:39 user nova-compute[75000]:   </features>
Nov 06 22:49:39 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:49:39 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:49:39 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:49:39 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:49:39 user nova-compute[75000]:   </clock>
Nov 06 22:49:39 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:49:39 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:49:39 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:49:39 user nova-compute[75000]:   </cpu>
Nov 06 22:49:39 user nova-compute[75000]:   <devices>
Nov 06 22:49:39 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:49:39 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:49:39 user nova-compute[75000]:       <source dev="/dev/sdb"/>
Nov 06 22:49:39 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:49:39 user nova-compute[75000]:       <serial>3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb</serial>
Nov 06 22:49:39 user nova-compute[75000]:     </disk>
Nov 06 22:49:39 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:49:39 user nova-compute[75000]:       <mac address="fa:16:3e:89:4e:72"/>
Nov 06 22:49:39 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:49:39 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:49:39 user nova-compute[75000]:       <target dev="tap1bd5c557-7e"/>
Nov 06 22:49:39 user nova-compute[75000]:     </interface>
Nov 06 22:49:39 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:49:39 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/d6faab59-7d75-41a0-961e-1b9566b0afe5/console.log" append="off"/>
Nov 06 22:49:39 user nova-compute[75000]:     </serial>
Nov 06 22:49:39 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:49:39 user nova-compute[75000]:     <video>
Nov 06 22:49:39 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:49:39 user nova-compute[75000]:     </video>
Nov 06 22:49:39 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:49:39 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:49:39 user nova-compute[75000]:     </rng>
Nov 06 22:49:39 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:49:39 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:49:39 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:49:39 user nova-compute[75000]:     </memballoon>
Nov 06 22:49:39 user nova-compute[75000]:   </devices>
Nov 06 22:49:39 user nova-compute[75000]: </domain>
Nov 06 22:49:39 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:48:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1520061310',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1520061310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1520061310',id=42,image_ref='fb4ac28a-ac37-4a0b-bbaf-cd11b5d9cb6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0lxEYtUNz36scr2uqiJge/tq+1bXkIaJboDZYdybrePrJzUf03EVh4PWeUe6WgPjEDu+/tRgpCDQkWJRUYlecjCtYJhxa/aHwyMxSyzugEBgbAZi6S+KCZRcDw5p9lNA==',key_name='tempest-keypair-871998994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-w5c1cn4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-673062967',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:48:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=d6faab59-7d75-41a0-961e-1b9566b0afe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:72,bridge_name='br-int',has_traffic_filtering=True,id=1bd5c557-7eec-4aec-a57f-128e07e29320,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd5c557-7e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG os_vif [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:72,bridge_name='br-int',has_traffic_filtering=True,id=1bd5c557-7eec-4aec-a57f-128e07e29320,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd5c557-7e') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '779e0f0d-fd68-5b9c-a46c-c17c3c3370a9', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bd5c557-7e, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bd5c557-7e, col_values=(('qos', UUID('7fac5b40-59dc-421e-9aca-134001e2643e')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bd5c557-7e, col_values=(('external_ids', {'iface-id': '1bd5c557-7eec-4aec-a57f-128e07e29320', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:4e:72', 'vm-uuid': 'd6faab59-7d75-41a0-961e-1b9566b0afe5'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:39 user nova-compute[75000]: INFO os_vif [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:72,bridge_name='br-int',has_traffic_filtering=True,id=1bd5c557-7eec-4aec-a57f-128e07e29320,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd5c557-7e')
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:49:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No VIF found with MAC fa:16:3e:89:4e:72, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:49:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-d252ca13-ed24-4a57-af38-44a00cd9be81 req-2e91701a-4d0d-4b22-8edb-f42364f84b41 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received event network-vif-plugged-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:49:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d252ca13-ed24-4a57-af38-44a00cd9be81 req-2e91701a-4d0d-4b22-8edb-f42364f84b41 service nova] Acquiring lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d252ca13-ed24-4a57-af38-44a00cd9be81 req-2e91701a-4d0d-4b22-8edb-f42364f84b41 service nova] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d252ca13-ed24-4a57-af38-44a00cd9be81 req-2e91701a-4d0d-4b22-8edb-f42364f84b41 service nova] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-d252ca13-ed24-4a57-af38-44a00cd9be81 req-2e91701a-4d0d-4b22-8edb-f42364f84b41 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] No waiting events found dispatching network-vif-plugged-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:49:41 user nova-compute[75000]: WARNING nova.compute.manager [req-d252ca13-ed24-4a57-af38-44a00cd9be81 req-2e91701a-4d0d-4b22-8edb-f42364f84b41 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received unexpected event network-vif-plugged-1bd5c557-7eec-4aec-a57f-128e07e29320 for instance with vm_state building and task_state spawning.
Nov 06 22:49:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:49:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Instance spawned successfully.
Nov 06 22:49:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:43 user nova-compute[75000]: INFO nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 06 22:49:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:49:43 user nova-compute[75000]: INFO nova.compute.manager [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Took 68.02 seconds to build instance.
Nov 06 22:49:43 user nova-compute[75000]: DEBUG nova.compute.manager [req-ecb8a2c0-39ce-4fa3-8e0c-ff3a2d4331df req-d6c6f9f9-a8c2-4bbf-9c11-745e2584a01f service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received event network-vif-plugged-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ecb8a2c0-39ce-4fa3-8e0c-ff3a2d4331df req-d6c6f9f9-a8c2-4bbf-9c11-745e2584a01f service nova] Acquiring lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ecb8a2c0-39ce-4fa3-8e0c-ff3a2d4331df req-d6c6f9f9-a8c2-4bbf-9c11-745e2584a01f service nova] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ecb8a2c0-39ce-4fa3-8e0c-ff3a2d4331df req-d6c6f9f9-a8c2-4bbf-9c11-745e2584a01f service nova] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG nova.compute.manager [req-ecb8a2c0-39ce-4fa3-8e0c-ff3a2d4331df req-d6c6f9f9-a8c2-4bbf-9c11-745e2584a01f service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] No waiting events found dispatching network-vif-plugged-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:49:43 user nova-compute[75000]: WARNING nova.compute.manager [req-ecb8a2c0-39ce-4fa3-8e0c-ff3a2d4331df req-d6c6f9f9-a8c2-4bbf-9c11-745e2584a01f service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received unexpected event network-vif-plugged-1bd5c557-7eec-4aec-a57f-128e07e29320 for instance with vm_state active and task_state None.
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c50ba6f0-b046-4448-a1ff-ffe252e39493 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 68.141s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:44 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:49:44 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8124MB free_disk=25.11954116821289GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 00ccddcc-6045-45df-a5a0-b0ccc54d862e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d6faab59-7d75-41a0-961e-1b9566b0afe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b04a54d9-a6c5-46a3-a709-929cf86a59e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:49:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:49:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:49:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:49:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:49:45 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:49:45 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:49:46 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updating instance_info_cache with network_info: [{"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:49:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:49:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:49:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZVKArUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:49:48 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:49:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:49:48 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:49:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:49:48 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c330a068-8dc5-4541-b232-8fec6e13e21e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:49:48 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c554550-2e8f-4efc-8d57-ea821681c4aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991] added
Nov 06 22:49:48 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c92b45-013c-4b4a-8e74-8015f3ac5c92]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30711fd-913a-4158-adcb-01e8fa39556f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MZVKArUL {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MZVKArUL" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd9257a-8b40-4cb1-b0dd-805d10a52415]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MZVKArUL'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90064ce-9e9e-4be4-a8a4-fbf3bd923678]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa88426-5ca9-49cb-bd91-578dc22420f1]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:49:49 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:49:49 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:49:49 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:49:49 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0f95d8-8c68-4590-bcde-e2ed72271496]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991, portal: 172.16.0.220,3260]
Nov 06 22:49:49 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991, portal: 172.16.0.220,3260] successful.
Nov 06 22:49:49 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a84894-2bd3-4cc3-8c65-4f564d503c1a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7b63f1-8f17-4c66-af27-f2330c41287f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:49:49 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:49:49 user nova-compute[75000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 (non-flash)
Nov 06 22:49:49 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:49:49 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:49:49 user nova-compute[75000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 (non-flash)
Nov 06 22:49:49 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[067c863e-b0bb-42b6-8af9-a00a2bb18a69]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:49:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZVKArUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26539663061393262', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539663061393262', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG nova.objects.instance [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'flavor' on Instance uuid ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:49:50 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:49:50 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:49:50 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:49:50 user nova-compute[75000]:   <serial>3a96564e-1f8e-4de2-a794-d71f70184991</serial>
Nov 06 22:49:50 user nova-compute[75000]: </disk>
Nov 06 22:49:50 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] No VIF found with MAC fa:16:3e:f2:47:ce, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:49:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3a5edd9d-5a0a-4fc9-bd03-94240d102b31 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.903s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:49:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:49:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:49:51 user nova-compute[75000]: INFO nova.compute.manager [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Detaching volume 3a96564e-1f8e-4de2-a794-d71f70184991
Nov 06 22:49:51 user nova-compute[75000]: INFO nova.virt.block_device [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Attempting to driver detach volume 3a96564e-1f8e-4de2-a794-d71f70184991 from mountpoint /dev/vdb
Nov 06 22:49:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Attempting to detach device vdb from instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:49:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:49:51 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:49:51 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:49:51 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:49:51 user nova-compute[75000]:   <serial>3a96564e-1f8e-4de2-a794-d71f70184991</serial>
Nov 06 22:49:51 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:49:51 user nova-compute[75000]: </disk>
Nov 06 22:49:51 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:49:51 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully detached device vdb from instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 from the persistent domain config.
Nov 06 22:49:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:49:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:49:51 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:49:51 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:49:51 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:49:51 user nova-compute[75000]:   <serial>3a96564e-1f8e-4de2-a794-d71f70184991</serial>
Nov 06 22:49:51 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:49:51 user nova-compute[75000]: </disk>
Nov 06 22:49:51 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:49:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:49:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-93772444-ea7d-4893-abc0-39498f296d99 req-23ffd0e5-2df5-47bd-b6fe-d23a71778133 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-changed-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:49:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-93772444-ea7d-4893-abc0-39498f296d99 req-23ffd0e5-2df5-47bd-b6fe-d23a71778133 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Refreshing instance network info cache due to event network-changed-c093b13d-e15d-4272-a9a0-23aa4f229e44. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:49:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-93772444-ea7d-4893-abc0-39498f296d99 req-23ffd0e5-2df5-47bd-b6fe-d23a71778133 service nova] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:49:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-93772444-ea7d-4893-abc0-39498f296d99 req-23ffd0e5-2df5-47bd-b6fe-d23a71778133 service nova] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:49:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-93772444-ea7d-4893-abc0-39498f296d99 req-23ffd0e5-2df5-47bd-b6fe-d23a71778133 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Refreshing network info cache for port c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:49:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:49:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-93772444-ea7d-4893-abc0-39498f296d99 req-23ffd0e5-2df5-47bd-b6fe-d23a71778133 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updated VIF entry in instance network info cache for port c093b13d-e15d-4272-a9a0-23aa4f229e44. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:49:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-93772444-ea7d-4893-abc0-39498f296d99 req-23ffd0e5-2df5-47bd-b6fe-d23a71778133 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:49:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-93772444-ea7d-4893-abc0-39498f296d99 req-23ffd0e5-2df5-47bd-b6fe-d23a71778133 service nova] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:49:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:49:55 user nova-compute[75000]: INFO nova.compute.manager [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] instance snapshotting
Nov 06 22:49:55 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Beginning live snapshot process
Nov 06 22:49:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json -f qcow2 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json -f qcow2 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0yft241o/6221130ca4034bca968e5287d3d8c0c1.delta 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0yft241o/6221130ca4034bca968e5287d3d8c0c1.delta 1073741824" returned: 0 in 0.061s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 22:49:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 22:49:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] COPY block job progress, current cursor: 24969216 final cursor: 75563008 {{(pid=75000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 22:49:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 22:49:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 22:49:58 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:49:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0yft241o/6221130ca4034bca968e5287d3d8c0c1.delta /opt/stack/data/nova/instances/snapshots/tmp0yft241o/6221130ca4034bca968e5287d3d8c0c1 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:49:59 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:49:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:49:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0yft241o/6221130ca4034bca968e5287d3d8c0c1.delta /opt/stack/data/nova/instances/snapshots/tmp0yft241o/6221130ca4034bca968e5287d3d8c0c1" returned: 0 in 1.041s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:49:59 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Snapshot extracted, beginning image upload
Nov 06 22:50:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:02 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Snapshot image upload complete
Nov 06 22:50:02 user nova-compute[75000]: INFO nova.compute.manager [None req-1ab51d2a-ea47-41f6-bce0-a9a6b543c071 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Took 6.67 seconds to snapshot the instance on the hypervisor.
Nov 06 22:50:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:11 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 is timed out.
Nov 06 22:50:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully detached device vdb from instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 from the live domain config.
Nov 06 22:50:11 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:50:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZVKArUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:50:11 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:50:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:50:11 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9783639-865d-4b8e-8260-dfe34efd058e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:50:12 user nova-compute[75000]: No targets found.
Nov 06 22:50:12 user nova-compute[75000]: iSNS:
Nov 06 22:50:12 user nova-compute[75000]: No targets found.
Nov 06 22:50:12 user nova-compute[75000]: STATIC:
Nov 06 22:50:12 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c
Nov 06 22:50:12 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:50:12 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:50:12 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb
Nov 06 22:50:12 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:50:12 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:50:12 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991
Nov 06 22:50:12 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:50:12 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:50:12 user nova-compute[75000]: FIRMWARE:
Nov 06 22:50:12 user nova-compute[75000]: No targets found.
Nov 06 22:50:12 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:50:12 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:50:12 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38af2648-dd36-443d-886e-27e1f6c31a5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5928fb8a-7abc-4148-a79d-ff8d8efedefc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:50:12 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:50:12 user nova-compute[75000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 (non-flash)
Nov 06 22:50:12 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:50:12 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:50:12 user nova-compute[75000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 (non-flash)
Nov 06 22:50:12 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc149000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe186cf-2ed5-4f93-9312-c5bebb67055e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[939cfdde-0e21-4ced-bd3c-5d8dc646886c]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5682f51d-ebd9-470c-9799-b276fd7c97f3]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e92202-14db-4b5c-b45f-e554cc43af34]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f653c20-d281-4a75-bf32-c3b06f84cabb]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b63419-3851-422f-ad40-b5a7a41af7c9]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991, portal: 172.16.0.220,3260]
Nov 06 22:50:12 user nova-compute[75000]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991, portal: 172.16.0.220,3260] successful.
Nov 06 22:50:12 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a96564e-1f8e-4de2-a794-d71f70184991 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bc5335-0abf-48a8-91e7-4e95f0f59832]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] <== disconnect_volume: return (308ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:50:12 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:50:13 user nova-compute[75000]: DEBUG nova.objects.instance [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'flavor' on Instance uuid ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:50:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-fc5def49-16a9-4d36-b758-b45d0b9c3c8e tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.920s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquiring lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquiring lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:21 user nova-compute[75000]: INFO nova.compute.manager [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Terminating instance
Nov 06 22:50:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:50:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed6b6ee3-06e7-4279-81d4-e0f4b7d2dae0 req-bc49fa16-f405-4571-a8b8-d5f6936fde24 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received event network-vif-unplugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed6b6ee3-06e7-4279-81d4-e0f4b7d2dae0 req-bc49fa16-f405-4571-a8b8-d5f6936fde24 service nova] Acquiring lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed6b6ee3-06e7-4279-81d4-e0f4b7d2dae0 req-bc49fa16-f405-4571-a8b8-d5f6936fde24 service nova] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed6b6ee3-06e7-4279-81d4-e0f4b7d2dae0 req-bc49fa16-f405-4571-a8b8-d5f6936fde24 service nova] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed6b6ee3-06e7-4279-81d4-e0f4b7d2dae0 req-bc49fa16-f405-4571-a8b8-d5f6936fde24 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] No waiting events found dispatching network-vif-unplugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed6b6ee3-06e7-4279-81d4-e0f4b7d2dae0 req-bc49fa16-f405-4571-a8b8-d5f6936fde24 service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received event network-vif-unplugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:50:22 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Instance destroyed successfully.
Nov 06 22:50:22 user nova-compute[75000]: DEBUG nova.objects.instance [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lazy-loading 'resources' on Instance uuid 00ccddcc-6045-45df-a5a0-b0ccc54d862e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:47:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1327831413',display_name='tempest-VolumesActionsTest-instance-1327831413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1327831413',id=40,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:48:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b307eb0a2b294083a88627727aee461a',ramdisk_id='',reservation_id='r-zpjbvepe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1724063732',owner_user_name='tempest-VolumesActionsTest-1724063732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:48:06Z,user_data=None,user_id='d83d252d12cb4563a7a0447ac91ad78c',uuid=00ccddcc-6045-45df-a5a0-b0ccc54d862e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Converting VIF {"id": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "address": "fa:16:3e:fa:37:32", "network": {"id": "73df18fe-fe69-421e-9407-807592801b94", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1869276217-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b307eb0a2b294083a88627727aee461a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e1cfd5-87", "ovs_interfaceid": "85e1cfd5-87a2-4059-8aff-e0d965d7d5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:37:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1cfd5-87a2-4059-8aff-e0d965d7d5a7,network=Network(73df18fe-fe69-421e-9407-807592801b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1cfd5-87') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG os_vif [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:37:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1cfd5-87a2-4059-8aff-e0d965d7d5a7,network=Network(73df18fe-fe69-421e-9407-807592801b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1cfd5-87') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85e1cfd5-87, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91687bb2-4143-4563-8309-7f80df1fef34) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:50:22 user nova-compute[75000]: INFO os_vif [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:37:32,bridge_name='br-int',has_traffic_filtering=True,id=85e1cfd5-87a2-4059-8aff-e0d965d7d5a7,network=Network(73df18fe-fe69-421e-9407-807592801b94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e1cfd5-87')
Nov 06 22:50:22 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Deleting instance files /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e_del
Nov 06 22:50:22 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Deletion of /opt/stack/data/nova/instances/00ccddcc-6045-45df-a5a0-b0ccc54d862e_del complete
Nov 06 22:50:22 user nova-compute[75000]: INFO nova.compute.manager [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 06 22:50:22 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:50:22 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:50:23 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:50:23 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Took 0.40 seconds to deallocate network for instance.
Nov 06 22:50:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:23 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:50:23 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:50:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:23 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Deleted allocations for instance 00ccddcc-6045-45df-a5a0-b0ccc54d862e
Nov 06 22:50:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-997ca3b2-d1de-47db-ade0-34c0bde90794 tempest-VolumesActionsTest-1724063732 tempest-VolumesActionsTest-1724063732-project-member] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.756s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-464f1e89-3157-4d45-a8a0-25f2a8f65bc5 req-dd7bd040-e96f-4857-89a9-1c6de62609be service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received event network-vif-plugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:50:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-464f1e89-3157-4d45-a8a0-25f2a8f65bc5 req-dd7bd040-e96f-4857-89a9-1c6de62609be service nova] Acquiring lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-464f1e89-3157-4d45-a8a0-25f2a8f65bc5 req-dd7bd040-e96f-4857-89a9-1c6de62609be service nova] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-464f1e89-3157-4d45-a8a0-25f2a8f65bc5 req-dd7bd040-e96f-4857-89a9-1c6de62609be service nova] Lock "00ccddcc-6045-45df-a5a0-b0ccc54d862e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-464f1e89-3157-4d45-a8a0-25f2a8f65bc5 req-dd7bd040-e96f-4857-89a9-1c6de62609be service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] No waiting events found dispatching network-vif-plugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:50:24 user nova-compute[75000]: WARNING nova.compute.manager [req-464f1e89-3157-4d45-a8a0-25f2a8f65bc5 req-dd7bd040-e96f-4857-89a9-1c6de62609be service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received unexpected event network-vif-plugged-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 for instance with vm_state deleted and task_state None.
Nov 06 22:50:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-464f1e89-3157-4d45-a8a0-25f2a8f65bc5 req-dd7bd040-e96f-4857-89a9-1c6de62609be service nova] [instance: 00ccddcc-6045-45df-a5a0-b0ccc54d862e] Received event network-vif-deleted-85e1cfd5-87a2-4059-8aff-e0d965d7d5a7 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:50:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:50:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:41 user nova-compute[75000]: INFO nova.compute.manager [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Terminating instance
Nov 06 22:50:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:50:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-82a0ad2f-f8a8-4337-a42d-9b6598329969 req-338521ad-8509-4f24-be39-9b42862bf7d7 service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received event network-vif-unplugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-82a0ad2f-f8a8-4337-a42d-9b6598329969 req-338521ad-8509-4f24-be39-9b42862bf7d7 service nova] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-82a0ad2f-f8a8-4337-a42d-9b6598329969 req-338521ad-8509-4f24-be39-9b42862bf7d7 service nova] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-82a0ad2f-f8a8-4337-a42d-9b6598329969 req-338521ad-8509-4f24-be39-9b42862bf7d7 service nova] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-82a0ad2f-f8a8-4337-a42d-9b6598329969 req-338521ad-8509-4f24-be39-9b42862bf7d7 service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] No waiting events found dispatching network-vif-unplugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-82a0ad2f-f8a8-4337-a42d-9b6598329969 req-338521ad-8509-4f24-be39-9b42862bf7d7 service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received event network-vif-unplugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Instance destroyed successfully.
Nov 06 22:50:42 user nova-compute[75000]: DEBUG nova.objects.instance [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lazy-loading 'resources' on Instance uuid ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-477443641',display_name='tempest-AttachVolumeNegativeTest-server-477443641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-477443641',id=39,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL3Bbh6y33cUMLqgWGYRx9yDYyUaPjePeP04gkuDis02HkMNVZlzpIi7+amhsiGbmP8ErNj7cItToQqWuml/0oiZZymyD/lkBKALg+wUVVW9PelOxnRPGy3k/W6Qm9UZw==',key_name='tempest-keypair-1646731834',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cf4f6360f6c486ab24087a20da8b6cb',ramdisk_id='',reservation_id='r-juw3qtay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-90304964',owner_user_name='tempest-AttachVolumeNegativeTest-90304964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:47:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f333b132a1474d983798ab0642b053',uuid=ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converting VIF {"id": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "address": "fa:16:3e:f2:47:ce", "network": {"id": "a9c0bf79-5518-40e4-a2b4-ef37174da457", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-745111946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf4f6360f6c486ab24087a20da8b6cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7843bb-4d", "ovs_interfaceid": "fb7843bb-4d08-4a40-843c-ff217cfa0561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:47:ce,bridge_name='br-int',has_traffic_filtering=True,id=fb7843bb-4d08-4a40-843c-ff217cfa0561,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7843bb-4d') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG os_vif [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:47:ce,bridge_name='br-int',has_traffic_filtering=True,id=fb7843bb-4d08-4a40-843c-ff217cfa0561,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7843bb-4d') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb7843bb-4d, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8945b77-195d-4cee-9f8f-1afc2a67bafe) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:42 user nova-compute[75000]: INFO os_vif [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:47:ce,bridge_name='br-int',has_traffic_filtering=True,id=fb7843bb-4d08-4a40-843c-ff217cfa0561,network=Network(a9c0bf79-5518-40e4-a2b4-ef37174da457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7843bb-4d')
Nov 06 22:50:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Deleting instance files /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61_del
Nov 06 22:50:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Deletion of /opt/stack/data/nova/instances/ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61_del complete
Nov 06 22:50:42 user nova-compute[75000]: INFO nova.compute.manager [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 06 22:50:42 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:50:42 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:50:43 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:50:43 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Took 0.61 seconds to deallocate network for instance.
Nov 06 22:50:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:43 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:50:43 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:50:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:43 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Deleted allocations for instance ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61
Nov 06 22:50:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b90ec645-ea4b-45d4-ac29-5189d6bf42f5 tempest-AttachVolumeNegativeTest-90304964 tempest-AttachVolumeNegativeTest-90304964-project-member] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.912s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-ece653ef-ae01-4d90-b711-5d89df8b1802 req-c1d18398-5411-4b75-8d69-e9200f21cf9f service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received event network-vif-plugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ece653ef-ae01-4d90-b711-5d89df8b1802 req-c1d18398-5411-4b75-8d69-e9200f21cf9f service nova] Acquiring lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ece653ef-ae01-4d90-b711-5d89df8b1802 req-c1d18398-5411-4b75-8d69-e9200f21cf9f service nova] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ece653ef-ae01-4d90-b711-5d89df8b1802 req-c1d18398-5411-4b75-8d69-e9200f21cf9f service nova] Lock "ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-ece653ef-ae01-4d90-b711-5d89df8b1802 req-c1d18398-5411-4b75-8d69-e9200f21cf9f service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] No waiting events found dispatching network-vif-plugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:50:44 user nova-compute[75000]: WARNING nova.compute.manager [req-ece653ef-ae01-4d90-b711-5d89df8b1802 req-c1d18398-5411-4b75-8d69-e9200f21cf9f service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received unexpected event network-vif-plugged-fb7843bb-4d08-4a40-843c-ff217cfa0561 for instance with vm_state deleted and task_state None.
Nov 06 22:50:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-ece653ef-ae01-4d90-b711-5d89df8b1802 req-c1d18398-5411-4b75-8d69-e9200f21cf9f service nova] [instance: ca2b308b-a320-40ea-a4a1-e0f1ef0b7e61] Received event network-vif-deleted-fb7843bb-4d08-4a40-843c-ff217cfa0561 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:50:45 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:50:45 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:50:45 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8339MB free_disk=25.114654541015625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d6faab59-7d75-41a0-961e-1b9566b0afe5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b04a54d9-a6c5-46a3-a709-929cf86a59e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:50:45 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:50:46 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:50:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:50:47 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:50:48 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:50:48 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:50:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:50:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:50:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:50:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:50:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-8c2c3cfd-6af7-4bc2-a158-d2a71699df5f req-b4e4841b-e887-4a12-a444-d88eeee65dd2 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-changed-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:51:01 user nova-compute[75000]: DEBUG nova.compute.manager [req-8c2c3cfd-6af7-4bc2-a158-d2a71699df5f req-b4e4841b-e887-4a12-a444-d88eeee65dd2 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Refreshing instance network info cache due to event network-changed-e9674a8f-d7bf-4285-8b50-d537e1950f5a. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:51:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8c2c3cfd-6af7-4bc2-a158-d2a71699df5f req-b4e4841b-e887-4a12-a444-d88eeee65dd2 service nova] Acquiring lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:51:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8c2c3cfd-6af7-4bc2-a158-d2a71699df5f req-b4e4841b-e887-4a12-a444-d88eeee65dd2 service nova] Acquired lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:51:01 user nova-compute[75000]: DEBUG nova.network.neutron [req-8c2c3cfd-6af7-4bc2-a158-d2a71699df5f req-b4e4841b-e887-4a12-a444-d88eeee65dd2 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Refreshing network info cache for port e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:51:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:51:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-8c2c3cfd-6af7-4bc2-a158-d2a71699df5f req-b4e4841b-e887-4a12-a444-d88eeee65dd2 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updated VIF entry in instance network info cache for port e9674a8f-d7bf-4285-8b50-d537e1950f5a. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:51:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-8c2c3cfd-6af7-4bc2-a158-d2a71699df5f req-b4e4841b-e887-4a12-a444-d88eeee65dd2 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updating instance_info_cache with network_info: [{"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:51:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8c2c3cfd-6af7-4bc2-a158-d2a71699df5f req-b4e4841b-e887-4a12-a444-d88eeee65dd2 service nova] Releasing lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:51:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:12 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:12 user nova-compute[75000]: INFO nova.compute.manager [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Shelving
Nov 06 22:51:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-62998950-4964-4dc1-82c3-8f5004fd4aa3 req-00b67217-ede6-41e9-b51a-809534fad259 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-unplugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:51:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-62998950-4964-4dc1-82c3-8f5004fd4aa3 req-00b67217-ede6-41e9-b51a-809534fad259 service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-62998950-4964-4dc1-82c3-8f5004fd4aa3 req-00b67217-ede6-41e9-b51a-809534fad259 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-62998950-4964-4dc1-82c3-8f5004fd4aa3 req-00b67217-ede6-41e9-b51a-809534fad259 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-62998950-4964-4dc1-82c3-8f5004fd4aa3 req-00b67217-ede6-41e9-b51a-809534fad259 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-unplugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:51:13 user nova-compute[75000]: WARNING nova.compute.manager [req-62998950-4964-4dc1-82c3-8f5004fd4aa3 req-00b67217-ede6-41e9-b51a-809534fad259 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-unplugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state active and task_state shelving.
Nov 06 22:51:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:13 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance destroyed successfully.
Nov 06 22:51:13 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Beginning cold snapshot process
Nov 06 22:51:13 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:51:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk /opt/stack/data/nova/instances/snapshots/tmp3qpeqlby/625784ed2861454cadc4ccbcad8f0b9d {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk /opt/stack/data/nova/instances/snapshots/tmp3qpeqlby/625784ed2861454cadc4ccbcad8f0b9d" returned: 0 in 0.922s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:14 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Snapshot extracted, beginning image upload
Nov 06 22:51:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-0bbeec80-0e2c-40a2-be84-53510e5c596c req-b28d28ff-ad22-4089-a3db-49914dd8087d service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:51:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0bbeec80-0e2c-40a2-be84-53510e5c596c req-b28d28ff-ad22-4089-a3db-49914dd8087d service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0bbeec80-0e2c-40a2-be84-53510e5c596c req-b28d28ff-ad22-4089-a3db-49914dd8087d service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0bbeec80-0e2c-40a2-be84-53510e5c596c req-b28d28ff-ad22-4089-a3db-49914dd8087d service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-0bbeec80-0e2c-40a2-be84-53510e5c596c req-b28d28ff-ad22-4089-a3db-49914dd8087d service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:51:15 user nova-compute[75000]: WARNING nova.compute.manager [req-0bbeec80-0e2c-40a2-be84-53510e5c596c req-b28d28ff-ad22-4089-a3db-49914dd8087d service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state active and task_state shelving_image_uploading.
Nov 06 22:51:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-c8cb0e9a-bb36-4ef7-a603-b260d28915dd req-b3d66e05-0159-4b97-a659-c978c5a20f12 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received event network-changed-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:51:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-c8cb0e9a-bb36-4ef7-a603-b260d28915dd req-b3d66e05-0159-4b97-a659-c978c5a20f12 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Refreshing instance network info cache due to event network-changed-1bd5c557-7eec-4aec-a57f-128e07e29320. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:51:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c8cb0e9a-bb36-4ef7-a603-b260d28915dd req-b3d66e05-0159-4b97-a659-c978c5a20f12 service nova] Acquiring lock "refresh_cache-d6faab59-7d75-41a0-961e-1b9566b0afe5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:51:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c8cb0e9a-bb36-4ef7-a603-b260d28915dd req-b3d66e05-0159-4b97-a659-c978c5a20f12 service nova] Acquired lock "refresh_cache-d6faab59-7d75-41a0-961e-1b9566b0afe5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:51:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-c8cb0e9a-bb36-4ef7-a603-b260d28915dd req-b3d66e05-0159-4b97-a659-c978c5a20f12 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Refreshing network info cache for port 1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:51:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-c8cb0e9a-bb36-4ef7-a603-b260d28915dd req-b3d66e05-0159-4b97-a659-c978c5a20f12 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Updated VIF entry in instance network info cache for port 1bd5c557-7eec-4aec-a57f-128e07e29320. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:51:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-c8cb0e9a-bb36-4ef7-a603-b260d28915dd req-b3d66e05-0159-4b97-a659-c978c5a20f12 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Updating instance_info_cache with network_info: [{"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c8cb0e9a-bb36-4ef7-a603-b260d28915dd req-b3d66e05-0159-4b97-a659-c978c5a20f12 service nova] Releasing lock "refresh_cache-d6faab59-7d75-41a0-961e-1b9566b0afe5" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "d6faab59-7d75-41a0-961e-1b9566b0afe5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:17 user nova-compute[75000]: INFO nova.compute.manager [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Terminating instance
Nov 06 22:51:17 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:17 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Instance destroyed successfully.
Nov 06 22:51:17 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'resources' on Instance uuid d6faab59-7d75-41a0-961e-1b9566b0afe5 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:48:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1520061310',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1520061310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1520061310',id=42,image_ref='fb4ac28a-ac37-4a0b-bbaf-cd11b5d9cb6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0lxEYtUNz36scr2uqiJge/tq+1bXkIaJboDZYdybrePrJzUf03EVh4PWeUe6WgPjEDu+/tRgpCDQkWJRUYlecjCtYJhxa/aHwyMxSyzugEBgbAZi6S+KCZRcDw5p9lNA==',key_name='tempest-keypair-871998994',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-w5c1cn4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-673062967',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=d6faab59-7d75-41a0-961e-1b9566b0afe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "1bd5c557-7eec-4aec-a57f-128e07e29320", "address": "fa:16:3e:89:4e:72", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd5c557-7e", "ovs_interfaceid": "1bd5c557-7eec-4aec-a57f-128e07e29320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:72,bridge_name='br-int',has_traffic_filtering=True,id=1bd5c557-7eec-4aec-a57f-128e07e29320,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd5c557-7e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG os_vif [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:72,bridge_name='br-int',has_traffic_filtering=True,id=1bd5c557-7eec-4aec-a57f-128e07e29320,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd5c557-7e') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bd5c557-7e, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:51:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Snapshot image upload complete
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fac5b40-59dc-421e-9aca-134001e2643e) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:18 user nova-compute[75000]: INFO os_vif [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:72,bridge_name='br-int',has_traffic_filtering=True,id=1bd5c557-7eec-4aec-a57f-128e07e29320,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd5c557-7e')
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyxkSpaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:51:18 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0183c375-2600-4441-afc2-4a8889be10ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:51:18 user nova-compute[75000]: No targets found.
Nov 06 22:51:18 user nova-compute[75000]: iSNS:
Nov 06 22:51:18 user nova-compute[75000]: No targets found.
Nov 06 22:51:18 user nova-compute[75000]: STATIC:
Nov 06 22:51:18 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c
Nov 06 22:51:18 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:51:18 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:51:18 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb
Nov 06 22:51:18 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:51:18 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:51:18 user nova-compute[75000]: FIRMWARE:
Nov 06 22:51:18 user nova-compute[75000]: No targets found.
Nov 06 22:51:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:51:18 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:51:18 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[938328ab-fbee-407c-80d2-4ac238cd03b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: INFO nova.compute.manager [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Shelve offloading
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[337fed98-be39-4768-8981-d7e84fd921d6]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:51:18 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:51:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:51:18 user nova-compute[75000]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb (non-flash)
Nov 06 22:51:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc23d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance destroyed successfully.
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquired lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.network.neutron [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8b23cb-2e99-4afe-9d15-33855a6f87fa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef986e9-9ca3-4c37-8696-6d65fbb35162]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a133933-56b2-44c4-8fc0-6a9d5044b4aa]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18bcc16-6ee0-4e90-8d45-641fe7f5a398]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObad458a-b63db2e8dce8291d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bad458a') {{(pid=86571) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 22:51:18 user nova-compute[75000]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIObad458a-b63db2e8dce8291d
Nov 06 22:51:18 user nova-compute[75000]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_bad458a
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9b9b9c-3430-4582-b174-e9dabd794579]: (4, None) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd98e56-e230-4697-9ef2-e71e43dbc1f9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[257d0e3f-aada-40b0-a262-cbf186352e9d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb, portal: 172.16.0.220,3260]
Nov 06 22:51:18 user nova-compute[75000]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb, portal: 172.16.0.220,3260] successful.
Nov 06 22:51:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c2a2f2-2513-4877-8be5-4541efd4d6e7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== disconnect_volume: return (410ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:51:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Deleting instance files /opt/stack/data/nova/instances/d6faab59-7d75-41a0-961e-1b9566b0afe5_del
Nov 06 22:51:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Deletion of /opt/stack/data/nova/instances/d6faab59-7d75-41a0-961e-1b9566b0afe5_del complete
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received event network-vif-unplugged-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] Acquiring lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] No waiting events found dispatching network-vif-unplugged-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received event network-vif-unplugged-1bd5c557-7eec-4aec-a57f-128e07e29320 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received event network-vif-plugged-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] Acquiring lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] No waiting events found dispatching network-vif-plugged-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:51:18 user nova-compute[75000]: WARNING nova.compute.manager [req-6082ae8e-f78b-4ede-81db-797e48fc5d3d req-ec71b561-f811-49ed-b9e7-5728ffb536d7 service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received unexpected event network-vif-plugged-1bd5c557-7eec-4aec-a57f-128e07e29320 for instance with vm_state active and task_state deleting.
Nov 06 22:51:18 user nova-compute[75000]: INFO nova.compute.manager [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Took 1.72 seconds to destroy the instance on the hypervisor.
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG nova.network.neutron [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updating instance_info_cache with network_info: [{"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:51:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Releasing lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:51:19 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance destroyed successfully.
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.objects.instance [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'resources' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-209577925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-209577925',id=43,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrES4qw0nR1lLXFRqevIQMp6bQWTTgmS5ngDzksjryuVEm4Ftg62UKG9Dhb6PlTaUhAGsmLa10P1f5VwBxliCoe1FTmxoBR6fUQ4nIsI31j5LQqMd10peGauFL4yr2Z6w==',key_name='tempest-keypair-1151415361',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-ea9l078y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member',shelved_at='2023-11-06T22:51:18.031715',shelved_host='user',shelved_image_id='4157d870-32e4-466d-9a96-ec4a1dd9c6b9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=b04a54d9-a6c5-46a3-a709-929cf86a59e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG os_vif [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9674a8f-d7, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc31acde-8035-4e7e-bde1-aa42c6955418) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:51:19 user nova-compute[75000]: INFO os_vif [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7')
Nov 06 22:51:19 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Deleting instance files /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3_del
Nov 06 22:51:19 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Deletion of /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3_del complete
Nov 06 22:51:19 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Deleted allocations for instance b04a54d9-a6c5-46a3-a709-929cf86a59e3
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:51:19 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Took 0.99 seconds to deallocate network for instance.
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.compute.manager [req-f5fab3e9-17a8-4a1b-8f82-c2a7c09abd5c req-9ca6318c-dba2-42e2-9a6b-104f391f8c4a service nova] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Received event network-vif-deleted-1bd5c557-7eec-4aec-a57f-128e07e29320 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.objects.instance [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'numa_topology' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.objects.base [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<b04a54d9-a6c5-46a3-a709-929cf86a59e3> lazy-loaded attributes: resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:51:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1da441a8-1c97-40ec-9593-95df406769b4 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.207s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:29 user nova-compute[75000]: INFO nova.compute.manager [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Took 9.29 seconds to detach 1 volumes for instance.
Nov 06 22:51:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: d6faab59-7d75-41a0-961e-1b9566b0afe5] Deleting volume: 3d6b8dc2-b833-4d30-bfe8-d00f5c4ed3eb {{(pid=75000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 22:51:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:29 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:51:29 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:51:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:29 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Deleted allocations for instance d6faab59-7d75-41a0-961e-1b9566b0afe5
Nov 06 22:51:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c91ad7f9-8736-429d-b8d1-65f1e4168928 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "d6faab59-7d75-41a0-961e-1b9566b0afe5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.643s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:30 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:45 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:46 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:51:46 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:51:46 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8590MB free_disk=25.073047637939453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:51:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:47 user nova-compute[75000]: DEBUG nova.objects.instance [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'flavor' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:51:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:48 user nova-compute[75000]: INFO nova.compute.manager [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Attaching volume db5b1519-f71d-455a-8c49-283a683852c8 to /dev/vdb
Nov 06 22:51:48 user nova-compute[75000]: DEBUG os_brick.utils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ef72cd-4902-48e4-827f-3c426ae815e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef996d60-4104-4bfc-adc7-6c72e1750f11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b511ba-9a07-4325-9c97-8543a5b1d5b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[82033ea8-914f-4d26-859c-54e9325c42cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:51:48 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:51:48 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b39676-d0de-491b-bd61-2f7324f44daf]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG os_brick.utils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:51:48 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating existing volume attachment record: e71ed770-7ca4-4d4a-9726-17520d1a297e {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:51:49 user nova-compute[75000]: INFO nova.compute.claims [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Claim successful on node user
Nov 06 22:51:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:51:49 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG nova.policy [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b32b1bcaeb147338db1e30c98d45cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f638f4062f446fadaee2a3bae01e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:51:49 user nova-compute[75000]: INFO nova.virt.block_device [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Booting with volume 15735879-6e23-4f08-9d25-9b36e3e3525b at /dev/vda
Nov 06 22:51:49 user nova-compute[75000]: DEBUG os_brick.utils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:51:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fcb551-fa26-4c2e-8c3d-34fb3c076ca4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5c193-439f-4253-8cd3-22fab944ca0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b966e94-9836-4580-8973-5bd7f5d8cade]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f998dae-66d5-48d9-9c83-4acaf782d956]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:51:50 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:51:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5f6fb4-ea6b-4609-9c95-7289647c1356]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG os_brick.utils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating existing volume attachment record: 147bf09e-b105-42ff-b44f-5b43b6e55b96 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Successfully created port: 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:51:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Successfully updated port: 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquired lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-9d1b3900-0d53-46fd-83f1-5e7359067eec req-a6478623-9b7c-47bd-be23-00588d039fa0 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-9d1b3900-0d53-46fd-83f1-5e7359067eec req-a6478623-9b7c-47bd-be23-00588d039fa0 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing instance network info cache due to event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9d1b3900-0d53-46fd-83f1-5e7359067eec req-a6478623-9b7c-47bd-be23-00588d039fa0 service nova] Acquiring lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.network.neutron [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Releasing lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Instance network_info: |[{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9d1b3900-0d53-46fd-83f1-5e7359067eec req-a6478623-9b7c-47bd-be23-00588d039fa0 service nova] Acquired lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:51:51 user nova-compute[75000]: DEBUG nova.network.neutron [req-9d1b3900-0d53-46fd-83f1-5e7359067eec req-a6478623-9b7c-47bd-be23-00588d039fa0 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:51:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:51:52 user nova-compute[75000]: DEBUG nova.network.neutron [req-9d1b3900-0d53-46fd-83f1-5e7359067eec req-a6478623-9b7c-47bd-be23-00588d039fa0 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updated VIF entry in instance network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:51:52 user nova-compute[75000]: DEBUG nova.network.neutron [req-9d1b3900-0d53-46fd-83f1-5e7359067eec req-a6478623-9b7c-47bd-be23-00588d039fa0 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:51:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9d1b3900-0d53-46fd-83f1-5e7359067eec req-a6478623-9b7c-47bd-be23-00588d039fa0 service nova] Releasing lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:51:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:51:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:00 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:00 user nova-compute[75000]: WARNING nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Nov 06 22:52:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:52:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:52:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 22:52:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:52:13 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Creating image(s)
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Ensure instance console log exists: /opt/stack/data/nova/instances/1f5ad59e-3dfa-40f2-b3bc-27d9b2514495/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Start _get_guest_xml network_info=[{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmapSoxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f5ad59e-3dfa-40f2-b3bc-27d9b2514495', 'attached_at': '', 'detached_at': '', 'volume_id': '15735879-6e23-4f08-9d25-9b36e3e3525b', 'serial': '15735879-6e23-4f08-9d25-9b36e3e3525b'}, 'attachment_id': '147bf09e-b105-42ff-b44f-5b43b6e55b96', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:52:13 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:52:13 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmapSoxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:52:13 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:52:13 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:52:13 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f50451-29e8-4462-b62e-de6c206f8cd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:52:13 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[67282ae7-bfc3-44a0-b4f4-63e5a442eec1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b] added
Nov 06 22:52:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2997d007-9c67-4b64-a22a-9f720ba04744]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eed142-9134-4294-8963-a691bb0b3865]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmapSoxe {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmapSoxe" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[038733db-c798-4414-b2e5-206e422b178b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jmapSoxe'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04aa9fa-09bd-4c6d-9d28-0d4e17848337]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8e64d7-f520-44b5-b92a-1dfc8fde11bb]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:52:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:52:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac312e7-ab25-4860-b183-063d857ae825]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260]
Nov 06 22:52:13 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260] successful.
Nov 06 22:52:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d459188-c466-45d7-a7b2-3aeeb8a5ae87]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[435e196e-7d74-4446-9b2b-32789c585bc0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:52:13 user nova-compute[75000]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:52:13 user nova-compute[75000]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:13 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[173bf5b3-94a5-4c53-8ee7-1190756b4033]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:52:13 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmapSoxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23063313461386133', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063313461386133', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581049709',display_name='tempest-TestShelveInstance-server-1581049709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581049709',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa+B84ATE/Y1pAOrul2P50e3pxv5IgVKs//Oid+onZBjofnCj7owKSgnbJwFnVEPZG/dGtvVBVDnWfud7yQMSM4afz51CQob0ROvPi1xMY3DFpVCyaJUgcNPpqiBg0dSA==',key_name='tempest-TestShelveInstance-1442804575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f638f4062f446fadaee2a3bae01e1a',ramdisk_id='',reservation_id='r-t0vw700y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1271715636',owner_user_name='tempest-TestShelveInstance-1271715636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:51:50Z,user_data=None,user_id='2b32b1bcaeb147338db1e30c98d45cef',uuid=1f5ad59e-3dfa-40f2-b3bc-27d9b2514495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converting VIF {"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.objects.instance [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:52:14 user nova-compute[75000]:   <uuid>1f5ad59e-3dfa-40f2-b3bc-27d9b2514495</uuid>
Nov 06 22:52:14 user nova-compute[75000]:   <name>instance-0000002c</name>
Nov 06 22:52:14 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:52:14 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:52:14 user nova-compute[75000]:   <metadata>
Nov 06 22:52:14 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:52:14 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:52:14 user nova-compute[75000]:       <nova:name>tempest-TestShelveInstance-server-1581049709</nova:name>
Nov 06 22:52:14 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:52:13</nova:creationTime>
Nov 06 22:52:14 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:52:14 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:52:14 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:52:14 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:52:14 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:52:14 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:52:14 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:52:14 user nova-compute[75000]:       <nova:owner>
Nov 06 22:52:14 user nova-compute[75000]:         <nova:user uuid="2b32b1bcaeb147338db1e30c98d45cef">tempest-TestShelveInstance-1271715636-project-member</nova:user>
Nov 06 22:52:14 user nova-compute[75000]:         <nova:project uuid="67f638f4062f446fadaee2a3bae01e1a">tempest-TestShelveInstance-1271715636</nova:project>
Nov 06 22:52:14 user nova-compute[75000]:       </nova:owner>
Nov 06 22:52:14 user nova-compute[75000]:       <nova:ports>
Nov 06 22:52:14 user nova-compute[75000]:         <nova:port uuid="1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8">
Nov 06 22:52:14 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 22:52:14 user nova-compute[75000]:         </nova:port>
Nov 06 22:52:14 user nova-compute[75000]:       </nova:ports>
Nov 06 22:52:14 user nova-compute[75000]:     </nova:instance>
Nov 06 22:52:14 user nova-compute[75000]:   </metadata>
Nov 06 22:52:14 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:52:14 user nova-compute[75000]:     <system>
Nov 06 22:52:14 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:52:14 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:52:14 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:52:14 user nova-compute[75000]:       <entry name="serial">1f5ad59e-3dfa-40f2-b3bc-27d9b2514495</entry>
Nov 06 22:52:14 user nova-compute[75000]:       <entry name="uuid">1f5ad59e-3dfa-40f2-b3bc-27d9b2514495</entry>
Nov 06 22:52:14 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:52:14 user nova-compute[75000]:     </system>
Nov 06 22:52:14 user nova-compute[75000]:   </sysinfo>
Nov 06 22:52:14 user nova-compute[75000]:   <os>
Nov 06 22:52:14 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:52:14 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:52:14 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:52:14 user nova-compute[75000]:   </os>
Nov 06 22:52:14 user nova-compute[75000]:   <features>
Nov 06 22:52:14 user nova-compute[75000]:     <acpi/>
Nov 06 22:52:14 user nova-compute[75000]:     <apic/>
Nov 06 22:52:14 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:52:14 user nova-compute[75000]:   </features>
Nov 06 22:52:14 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:52:14 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:52:14 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:52:14 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:52:14 user nova-compute[75000]:   </clock>
Nov 06 22:52:14 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:52:14 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:52:14 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:52:14 user nova-compute[75000]:   </cpu>
Nov 06 22:52:14 user nova-compute[75000]:   <devices>
Nov 06 22:52:14 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:52:14 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:52:14 user nova-compute[75000]:       <source dev="/dev/sdb"/>
Nov 06 22:52:14 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:52:14 user nova-compute[75000]:       <serial>15735879-6e23-4f08-9d25-9b36e3e3525b</serial>
Nov 06 22:52:14 user nova-compute[75000]:     </disk>
Nov 06 22:52:14 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:52:14 user nova-compute[75000]:       <mac address="fa:16:3e:b9:51:12"/>
Nov 06 22:52:14 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:52:14 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:52:14 user nova-compute[75000]:       <target dev="tap1b8ac5f3-39"/>
Nov 06 22:52:14 user nova-compute[75000]:     </interface>
Nov 06 22:52:14 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:52:14 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/1f5ad59e-3dfa-40f2-b3bc-27d9b2514495/console.log" append="off"/>
Nov 06 22:52:14 user nova-compute[75000]:     </serial>
Nov 06 22:52:14 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:52:14 user nova-compute[75000]:     <video>
Nov 06 22:52:14 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:52:14 user nova-compute[75000]:     </video>
Nov 06 22:52:14 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:52:14 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:52:14 user nova-compute[75000]:     </rng>
Nov 06 22:52:14 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:52:14 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:52:14 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:52:14 user nova-compute[75000]:     </memballoon>
Nov 06 22:52:14 user nova-compute[75000]:   </devices>
Nov 06 22:52:14 user nova-compute[75000]: </domain>
Nov 06 22:52:14 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581049709',display_name='tempest-TestShelveInstance-server-1581049709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581049709',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa+B84ATE/Y1pAOrul2P50e3pxv5IgVKs//Oid+onZBjofnCj7owKSgnbJwFnVEPZG/dGtvVBVDnWfud7yQMSM4afz51CQob0ROvPi1xMY3DFpVCyaJUgcNPpqiBg0dSA==',key_name='tempest-TestShelveInstance-1442804575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67f638f4062f446fadaee2a3bae01e1a',ramdisk_id='',reservation_id='r-t0vw700y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1271715636',owner_user_name='tempest-TestShelveInstance-1271715636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:51:50Z,user_data=None,user_id='2b32b1bcaeb147338db1e30c98d45cef',uuid=1f5ad59e-3dfa-40f2-b3bc-27d9b2514495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converting VIF {"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG os_vif [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f3efeb9-18e0-5d84-9745-66563726643e', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b8ac5f3-39, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b8ac5f3-39, col_values=(('qos', UUID('25eb7ce8-2a06-4b45-8bbf-031502af152e')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b8ac5f3-39, col_values=(('external_ids', {'iface-id': '1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:51:12', 'vm-uuid': '1f5ad59e-3dfa-40f2-b3bc-27d9b2514495'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:14 user nova-compute[75000]: INFO os_vif [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39')
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:52:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] No VIF found with MAC fa:16:3e:b9:51:12, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:52:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-e46d6884-d8cb-4977-92f4-a0a91ff8da70 req-1849465f-d96a-4ebb-80c7-a7c7ca825cc1 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:52:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e46d6884-d8cb-4977-92f4-a0a91ff8da70 req-1849465f-d96a-4ebb-80c7-a7c7ca825cc1 service nova] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e46d6884-d8cb-4977-92f4-a0a91ff8da70 req-1849465f-d96a-4ebb-80c7-a7c7ca825cc1 service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e46d6884-d8cb-4977-92f4-a0a91ff8da70 req-1849465f-d96a-4ebb-80c7-a7c7ca825cc1 service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-e46d6884-d8cb-4977-92f4-a0a91ff8da70 req-1849465f-d96a-4ebb-80c7-a7c7ca825cc1 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] No waiting events found dispatching network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:52:16 user nova-compute[75000]: WARNING nova.compute.manager [req-e46d6884-d8cb-4977-92f4-a0a91ff8da70 req-1849465f-d96a-4ebb-80c7-a7c7ca825cc1 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received unexpected event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 for instance with vm_state building and task_state spawning.
Nov 06 22:52:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:52:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Instance spawned successfully.
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:52:18 user nova-compute[75000]: INFO nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-33258ab2-6828-488b-912b-ba66a35aab58 req-e40f05e7-55ee-4f43-8b56-8b9013308550 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-33258ab2-6828-488b-912b-ba66a35aab58 req-e40f05e7-55ee-4f43-8b56-8b9013308550 service nova] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-33258ab2-6828-488b-912b-ba66a35aab58 req-e40f05e7-55ee-4f43-8b56-8b9013308550 service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-33258ab2-6828-488b-912b-ba66a35aab58 req-e40f05e7-55ee-4f43-8b56-8b9013308550 service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-33258ab2-6828-488b-912b-ba66a35aab58 req-e40f05e7-55ee-4f43-8b56-8b9013308550 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] No waiting events found dispatching network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:52:18 user nova-compute[75000]: WARNING nova.compute.manager [req-33258ab2-6828-488b-912b-ba66a35aab58 req-e40f05e7-55ee-4f43-8b56-8b9013308550 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received unexpected event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 for instance with vm_state building and task_state spawning.
Nov 06 22:52:18 user nova-compute[75000]: INFO nova.compute.manager [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Took 29.44 seconds to build instance.
Nov 06 22:52:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-f1e337d8-678a-4b59-a51c-5e95caee8046 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.539s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.521s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:18 user nova-compute[75000]: INFO nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 06 22:52:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:19 user nova-compute[75000]: INFO nova.compute.manager [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Terminating instance
Nov 06 22:52:19 user nova-compute[75000]: DEBUG nova.compute.manager [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:20 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Instance destroyed successfully.
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.objects.instance [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'resources' on Instance uuid 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-181185970',display_name='tempest-TestVolumeBootPattern-volume-backed-server-181185970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-181185970',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHMvJtV4S48O3BWv7tZVQsgO3omOWcAD8W2qxKCaxRBpaWa/qUuSPB72d8wy5WR1vLcXgmaddVh249KC30F0xrnws6vl1XvHKwY1GhIUSzz28vYP2XS28x8M3gSFWYOMg==',key_name='tempest-keypair-469512859',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:46:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-cpcl4f8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=6bb78cec-cf14-4bcb-ac7c-b3d57e33b393,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "address": "fa:16:3e:07:2f:30", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa643ce-ec", "ovs_interfaceid": "ffa643ce-ec44-4d3d-be6e-766df9e123fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:2f:30,bridge_name='br-int',has_traffic_filtering=True,id=ffa643ce-ec44-4d3d-be6e-766df9e123fc,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa643ce-ec') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_vif [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:2f:30,bridge_name='br-int',has_traffic_filtering=True,id=ffa643ce-ec44-4d3d-be6e-766df9e123fc,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa643ce-ec') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffa643ce-ec, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=606ab5ac-5321-44b5-88de-5c3a6a5323dd) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:52:20 user nova-compute[75000]: INFO os_vif [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:2f:30,bridge_name='br-int',has_traffic_filtering=True,id=ffa643ce-ec44-4d3d-be6e-766df9e123fc,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa643ce-ec')
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDBCPcWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:52:20 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b610cf6-ce24-4e7a-925a-3a777158e50e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:52:20 user nova-compute[75000]: No targets found.
Nov 06 22:52:20 user nova-compute[75000]: iSNS:
Nov 06 22:52:20 user nova-compute[75000]: No targets found.
Nov 06 22:52:20 user nova-compute[75000]: STATIC:
Nov 06 22:52:20 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c
Nov 06 22:52:20 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:52:20 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:52:20 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b
Nov 06 22:52:20 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:52:20 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:52:20 user nova-compute[75000]: FIRMWARE:
Nov 06 22:52:20 user nova-compute[75000]: No targets found.
Nov 06 22:52:20 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:52:20 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:52:20 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0cf488-87d7-4262-b111-e016d2b5a8be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa1a4d-e0a7-45d8-86e3-e558bffea4ba]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:52:20 user nova-compute[75000]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:20 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c (non-flash)
Nov 06 22:52:20 user nova-compute[75000]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:20 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc14b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c'): ({'sdd'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Removing single pathed devices sdd {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ce1cb3-62e6-4d00-929e-23fe3a82ec63]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.037s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e610aec5-0b05-4353-ada9-9927678b2101]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flushing IO for device /dev/sdd {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[519e5786-dcff-4f58-b2ab-1639990ff4a1]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6258ef-f895-4f58-821b-2c8f87cef892]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[905c1542-07af-487e-ac37-a4662df07145]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16edff-c6b5-49a3-a311-3697124d1a32]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c, portal: 172.16.0.220,3260]
Nov 06 22:52:20 user nova-compute[75000]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c, portal: 172.16.0.220,3260] successful.
Nov 06 22:52:20 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1334b97-bf06-4ffa-9c89-487391fbde7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bcba62-bf41-46a9-9de2-552749eac2bf]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== disconnect_volume: return (366ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:52:20 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Deleting instance files /opt/stack/data/nova/instances/6bb78cec-cf14-4bcb-ac7c-b3d57e33b393_del
Nov 06 22:52:20 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Deletion of /opt/stack/data/nova/instances/6bb78cec-cf14-4bcb-ac7c-b3d57e33b393_del complete
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received event network-vif-unplugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] Acquiring lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] No waiting events found dispatching network-vif-unplugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received event network-vif-unplugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received event network-vif-plugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] Acquiring lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] No waiting events found dispatching network-vif-plugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:52:20 user nova-compute[75000]: WARNING nova.compute.manager [req-ed4d8bb8-d6e7-45a7-9e3c-82e775dac265 req-8c3901fa-72b7-4bd6-9da7-ac5b64a2b9d8 service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received unexpected event network-vif-plugged-ffa643ce-ec44-4d3d-be6e-766df9e123fc for instance with vm_state active and task_state deleting.
Nov 06 22:52:20 user nova-compute[75000]: INFO nova.compute.manager [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 06 22:52:20 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:52:20 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:52:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:21 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:52:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-59b9ae98-b0cd-4550-9277-3a7ecadbe9b1 req-6dad4c9f-c26e-4fb7-a082-a26082be0eaf service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Received event network-vif-deleted-ffa643ce-ec44-4d3d-be6e-766df9e123fc {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:52:21 user nova-compute[75000]: INFO nova.compute.manager [req-59b9ae98-b0cd-4550-9277-3a7ecadbe9b1 req-6dad4c9f-c26e-4fb7-a082-a26082be0eaf service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Neutron deleted interface ffa643ce-ec44-4d3d-be6e-766df9e123fc; detaching it from the instance and deleting it from the info cache
Nov 06 22:52:21 user nova-compute[75000]: DEBUG nova.network.neutron [req-59b9ae98-b0cd-4550-9277-3a7ecadbe9b1 req-6dad4c9f-c26e-4fb7-a082-a26082be0eaf service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:52:21 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Took 1.11 seconds to deallocate network for instance.
Nov 06 22:52:21 user nova-compute[75000]: DEBUG nova.compute.manager [req-59b9ae98-b0cd-4550-9277-3a7ecadbe9b1 req-6dad4c9f-c26e-4fb7-a082-a26082be0eaf service nova] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Detach interface failed, port_id=ffa643ce-ec44-4d3d-be6e-766df9e123fc, reason: Instance 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393 could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:52:23 user nova-compute[75000]: INFO nova.compute.manager [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Took 1.23 seconds to detach 1 volumes for instance.
Nov 06 22:52:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393] Deleting volume: d1334b97-bf06-4ffa-9c89-487391fbde7c {{(pid=75000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 22:52:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:23 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 22:52:23 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 22:52:23 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 22:52:23 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 22:52:23 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 22:52:23 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:52:23 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:52:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.890s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:24 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Deleted allocations for instance 6bb78cec-cf14-4bcb-ac7c-b3d57e33b393
Nov 06 22:52:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-97ec6b75-15ac-4926-a974-ce474b5f7d3c tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "6bb78cec-cf14-4bcb-ac7c-b3d57e33b393" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.089s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:52:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMZSPIVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:52:42 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:52:42 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:52:42 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec40f50b-8b98-4caa-a045-ade02b51fe3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:52:42 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.083s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc876c31-a995-4a93-b6de-4813b80d38ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8] added
Nov 06 22:52:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40e7038-5308-4040-b4e7-dbb503e7e7a6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a57389-6747-42e1-ab93-6cfc7a1f4cc2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMZSPIVT {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMZSPIVT" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4926d0-2485-469a-a7d8-238ae016f7f9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gMZSPIVT'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[178b0ada-ea38-4069-b7ce-2be49121fa62]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed43f52-930a-497a-866e-2665a48710c2]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[64934633-bd40-43df-b804-5b45eac118cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8, portal: 172.16.0.220,3260]
Nov 06 22:52:42 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8, portal: 172.16.0.220,3260] successful.
Nov 06 22:52:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdb17d1-8314-4f21-a74c-7239eb049858]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a00acf-12fc-4c01-96e8-7f26301d1902]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:42 user nova-compute[75000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:52:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:42 user nova-compute[75000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:52:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb9f35-e0a5-4898-bd52-d95b816b2b28]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:52:43 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:52:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMZSPIVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:52:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:52:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23961303265333933', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:52:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961303265333933', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:52:43 user nova-compute[75000]: DEBUG nova.objects.instance [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'flavor' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 22:52:44 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:52:44 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:52:44 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:52:44 user nova-compute[75000]:   <serial>db5b1519-f71d-455a-8c49-283a683852c8</serial>
Nov 06 22:52:44 user nova-compute[75000]: </disk>
Nov 06 22:52:44 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 22:52:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:52:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:52:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] No VIF found with MAC fa:16:3e:69:c3:d6, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:52:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-aa69879a-c0d0-4f30-85cd-40edf74d51bf tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 56.703s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 44.420s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:45 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:45 user nova-compute[75000]: INFO nova.compute.manager [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Rescuing
Nov 06 22:52:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:52:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:52:45 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:52:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:45 user nova-compute[75000]: DEBUG nova.network.neutron [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:52:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-a4d86977-719f-419b-b568-b89bc2252415 req-c2cd4417-8157-483a-81b6-d1289aa49eb0 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-unplugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a4d86977-719f-419b-b568-b89bc2252415 req-c2cd4417-8157-483a-81b6-d1289aa49eb0 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a4d86977-719f-419b-b568-b89bc2252415 req-c2cd4417-8157-483a-81b6-d1289aa49eb0 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a4d86977-719f-419b-b568-b89bc2252415 req-c2cd4417-8157-483a-81b6-d1289aa49eb0 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-a4d86977-719f-419b-b568-b89bc2252415 req-c2cd4417-8157-483a-81b6-d1289aa49eb0 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-unplugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:52:46 user nova-compute[75000]: WARNING nova.compute.manager [req-a4d86977-719f-419b-b568-b89bc2252415 req-c2cd4417-8157-483a-81b6-d1289aa49eb0 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-unplugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state active and task_state rescuing.
Nov 06 22:52:46 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Instance destroyed successfully.
Nov 06 22:52:46 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Attempting a stable device rescue
Nov 06 22:52:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Instance directory exists: not creating {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 22:52:46 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Creating image(s)
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:46 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'trusted_certs' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "2f6832075b46992de27bee4578ee01623870291b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "2f6832075b46992de27bee4578ee01623870291b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:47 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:52:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 1.154s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG nova.virt.images [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] 9d7593bd-aca5-4159-843a-882ef9d64c47 was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b.part /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-8e34470a-f05c-4674-b9b7-57430fdadd67 req-ef5a2d33-6d38-4b60-ba2a-31eed1b03ab4 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8e34470a-f05c-4674-b9b7-57430fdadd67 req-ef5a2d33-6d38-4b60-ba2a-31eed1b03ab4 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8e34470a-f05c-4674-b9b7-57430fdadd67 req-ef5a2d33-6d38-4b60-ba2a-31eed1b03ab4 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8e34470a-f05c-4674-b9b7-57430fdadd67 req-ef5a2d33-6d38-4b60-ba2a-31eed1b03ab4 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG nova.compute.manager [req-8e34470a-f05c-4674-b9b7-57430fdadd67 req-ef5a2d33-6d38-4b60-ba2a-31eed1b03ab4 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:52:48 user nova-compute[75000]: WARNING nova.compute.manager [req-8e34470a-f05c-4674-b9b7-57430fdadd67 req-ef5a2d33-6d38-4b60-ba2a-31eed1b03ab4 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state active and task_state rescuing.
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b.part /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b.converted" returned: 0 in 0.563s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:48 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:52:48 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:52:48 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8610MB free_disk=25.06015396118164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "2f6832075b46992de27bee4578ee01623870291b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.140s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "2f6832075b46992de27bee4578ee01623870291b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "2f6832075b46992de27bee4578ee01623870291b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b --force-share --output=json" returned: 0 in 0.207s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b,backing_fmt=raw /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.rescue {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b,backing_fmt=raw /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.rescue" returned: 0 in 0.058s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "2f6832075b46992de27bee4578ee01623870291b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'migration_context' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Object Instance<f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Start _get_guest_xml network_info=[{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "vif_mac": "fa:16:3e:69:c3:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9d7593bd-aca5-4159-843a-882ef9d64c47', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMZSPIVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb', 'attached_at': '', 'detached_at': '', 'volume_id': 'db5b1519-f71d-455a-8c49-283a683852c8', 'serial': 'db5b1519-f71d-455a-8c49-283a683852c8'}, 'attachment_id': 'e71ed770-7ca4-4d4a-9726-17520d1a297e', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'resources' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Object Instance<f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'numa_topology' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Object Instance<f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:52:49 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:52:49 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Object Instance<f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMZSPIVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:52:49 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:52:49 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:52:49 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f887f48-81b9-46e1-ae99-a1dd46e02fe6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gMZSPIVT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 22:52:49 user nova-compute[75000]: node.name = iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8
Nov 06 22:52:49 user nova-compute[75000]: node.tpgt = -1
Nov 06 22:52:49 user nova-compute[75000]: node.startup = automatic
Nov 06 22:52:49 user nova-compute[75000]: node.leading_login = No
Nov 06 22:52:49 user nova-compute[75000]: iface.iscsi_ifacename = default
Nov 06 22:52:49 user nova-compute[75000]: iface.net_ifacename = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.ipaddress = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.prefix_len = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.hwaddress = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.transport_name = tcp
Nov 06 22:52:49 user nova-compute[75000]: iface.initiatorname = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.state = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.vlan_id = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.vlan_priority = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.vlan_state = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.iface_num = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.mtu = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.port = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.bootproto = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.subnet_mask = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.gateway = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.dhcp_alt_client_id = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.dhcp_dns = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.dhcp_learn_iqn = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.dhcp_vendor_id_state = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.dhcp_vendor_id = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.dhcp_slp_da = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.fragmentation = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.gratuitous_arp = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.incoming_forwarding = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.tos_state = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.tos = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.ttl = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.delayed_ack = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.tcp_nagle = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.tcp_wsf_state = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.tcp_wsf = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.tcp_timer_scale = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.tcp_timestamp = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.redirect = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.def_task_mgmt_timeout = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.header_digest = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.data_digest = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.immediate_data = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.initial_r2t = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.data_seq_inorder = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.data_pdu_inorder = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.erl = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.max_receive_data_len = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.first_burst_len = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.max_outstanding_r2t = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.max_burst_len = 0
Nov 06 22:52:49 user nova-compute[75000]: iface.chap_auth = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.bidi_chap = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.strict_login_compliance = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.discovery_auth = <empty>
Nov 06 22:52:49 user nova-compute[75000]: iface.discovery_logout = <empty>
Nov 06 22:52:49 user nova-compute[75000]: node.discovery_address = <empty>
Nov 06 22:52:49 user nova-compute[75000]: node.discovery_port = 0
Nov 06 22:52:49 user nova-compute[75000]: node.discovery_type = static
Nov 06 22:52:49 user nova-compute[75000]: node.session.initial_cmdsn = 0
Nov 06 22:52:49 user nova-compute[75000]: node.session.initial_login_retry_max = 8
Nov 06 22:52:49 user nova-compute[75000]: node.session.xmit_thread_priority = -20
Nov 06 22:52:49 user nova-compute[75000]: node.session.cmds_max = 128
Nov 06 22:52:49 user nova-compute[75000]: node.session.queue_depth = 32
Nov 06 22:52:49 user nova-compute[75000]: node.session.nr_sessions = 1
Nov 06 22:52:49 user nova-compute[75000]: node.session.auth.authmethod = CHAP
Nov 06 22:52:49 user nova-compute[75000]: node.session.auth.username = gMZSPIVT
Nov 06 22:52:49 user nova-compute[75000]: node.session.auth.password = ***
Nov 06 22:52:49 user nova-compute[75000]: node.session.auth.username_in = <empty>
Nov 06 22:52:49 user nova-compute[75000]: node.session.auth.password_in = <empty>
Nov 06 22:52:49 user nova-compute[75000]: node.session.auth.chap_algs = MD5
Nov 06 22:52:49 user nova-compute[75000]: node.session.timeo.replacement_timeout = 120
Nov 06 22:52:49 user nova-compute[75000]: node.session.err_timeo.abort_timeout = 15
Nov 06 22:52:49 user nova-compute[75000]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 22:52:49 user nova-compute[75000]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 22:52:49 user nova-compute[75000]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.FastAbort = Yes
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.InitialR2T = No
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.ImmediateData = Yes
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.MaxConnections = 1
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 22:52:49 user nova-compute[75000]: node.session.iscsi.ERL = 0
Nov 06 22:52:49 user nova-compute[75000]: node.session.scan = manual
Nov 06 22:52:49 user nova-compute[75000]: node.session.reopen_max = 0
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].address = 172.16.0.220
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].port = 3260
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].startup = manual
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].tcp.window_size = 524288
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].tcp.type_of_service = 0
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].timeo.logout_timeout = 15
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].timeo.login_timeout = 15
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].timeo.auth_timeout = 45
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].iscsi.DataDigest = None
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].iscsi.IFMarker = No
Nov 06 22:52:49 user nova-compute[75000]: node.conn[0].iscsi.OFMarker = No
Nov 06 22:52:49 user nova-compute[75000]: # END RECORD
Nov 06 22:52:49 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[652a7e77-0535-403f-bc34-da78e5548c74]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d546b3-ae09-4cbc-b269-0f6d65bdb9db]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMZSPIVT {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMZSPIVT" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3442b347-a182-4833-9d37-93a67adf145e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gMZSPIVT'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7459295-eeb6-4a0d-8059-56e9d6f65776]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bced0d71-708d-4a30-91bc-2c254676a98c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:49 user nova-compute[75000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:52:49 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:52:49 user nova-compute[75000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:52:49 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] HCTL ('34', '0', '0', 0) found on session 47 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42224047-6c35-4a5f-916a-e7e5547fc04f]: (4, ('0 0 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Searching for a device in session 47 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMZSPIVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.191s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '23961303265333933', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961303265333933', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1189826598',display_name='tempest-ServerStableDeviceRescueTest-server-1189826598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1189826598',id=41,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORt/xe/qSCDRGFI+7o9IH3tOWYDAW2JZNFvkbb1iGWCHMFgXb10IUNmaEuJ66afGNp1bVppMJMGYR4sJF7amMJ0D3JRACjU8VESaniP/DxVcM9BosmY0u9WRA18TtyuaQ==',key_name='tempest-keypair-805493755',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:48:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='532cabdfcc5f44bb89dd80655c501c60',ramdisk_id='',reservation_id='r-lieke9cv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-457048010',owner_user_name='tempest-ServerStableDeviceRescueTest-457048010-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:50:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f6f1e5f89e4392ae445be927fd82c0',uuid=f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "vif_mac": "fa:16:3e:69:c3:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Converting VIF {"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "vif_mac": "fa:16:3e:69:c3:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=c093b13d-e15d-4272-a9a0-23aa4f229e44,network=Network(d9586576-fa73-42e6-8175-f0e8108b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc093b13d-e1') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'pci_devices' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.objects.base [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Object Instance<f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:52:49 user nova-compute[75000]:   <uuid>f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb</uuid>
Nov 06 22:52:49 user nova-compute[75000]:   <name>instance-00000029</name>
Nov 06 22:52:49 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:52:49 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:52:49 user nova-compute[75000]:   <metadata>
Nov 06 22:52:49 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:52:49 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:52:49 user nova-compute[75000]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1189826598</nova:name>
Nov 06 22:52:49 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:52:49</nova:creationTime>
Nov 06 22:52:49 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:52:49 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:52:49 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:52:49 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:52:49 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:52:49 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:52:49 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:52:49 user nova-compute[75000]:       <nova:owner>
Nov 06 22:52:49 user nova-compute[75000]:         <nova:user uuid="40f6f1e5f89e4392ae445be927fd82c0">tempest-ServerStableDeviceRescueTest-457048010-project-member</nova:user>
Nov 06 22:52:49 user nova-compute[75000]:         <nova:project uuid="532cabdfcc5f44bb89dd80655c501c60">tempest-ServerStableDeviceRescueTest-457048010</nova:project>
Nov 06 22:52:49 user nova-compute[75000]:       </nova:owner>
Nov 06 22:52:49 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:52:49 user nova-compute[75000]:       <nova:ports>
Nov 06 22:52:49 user nova-compute[75000]:         <nova:port uuid="c093b13d-e15d-4272-a9a0-23aa4f229e44">
Nov 06 22:52:49 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 22:52:49 user nova-compute[75000]:         </nova:port>
Nov 06 22:52:49 user nova-compute[75000]:       </nova:ports>
Nov 06 22:52:49 user nova-compute[75000]:     </nova:instance>
Nov 06 22:52:49 user nova-compute[75000]:   </metadata>
Nov 06 22:52:49 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:52:49 user nova-compute[75000]:     <system>
Nov 06 22:52:49 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:52:49 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:52:49 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:52:49 user nova-compute[75000]:       <entry name="serial">f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb</entry>
Nov 06 22:52:49 user nova-compute[75000]:       <entry name="uuid">f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb</entry>
Nov 06 22:52:49 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:52:49 user nova-compute[75000]:     </system>
Nov 06 22:52:49 user nova-compute[75000]:   </sysinfo>
Nov 06 22:52:49 user nova-compute[75000]:   <os>
Nov 06 22:52:49 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:52:49 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:52:49 user nova-compute[75000]:   </os>
Nov 06 22:52:49 user nova-compute[75000]:   <features>
Nov 06 22:52:49 user nova-compute[75000]:     <acpi/>
Nov 06 22:52:49 user nova-compute[75000]:     <apic/>
Nov 06 22:52:49 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:52:49 user nova-compute[75000]:   </features>
Nov 06 22:52:49 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:52:49 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:52:49 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:52:49 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:52:49 user nova-compute[75000]:   </clock>
Nov 06 22:52:49 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:52:49 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:52:49 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:52:49 user nova-compute[75000]:   </cpu>
Nov 06 22:52:49 user nova-compute[75000]:   <devices>
Nov 06 22:52:49 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:52:49 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:52:49 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk"/>
Nov 06 22:52:49 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:52:49 user nova-compute[75000]:     </disk>
Nov 06 22:52:49 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:52:49 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:52:49 user nova-compute[75000]:       <source dev="/dev/sdc"/>
Nov 06 22:52:49 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 22:52:49 user nova-compute[75000]:       <serial>db5b1519-f71d-455a-8c49-283a683852c8</serial>
Nov 06 22:52:49 user nova-compute[75000]:     </disk>
Nov 06 22:52:49 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:52:49 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:52:49 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.rescue"/>
Nov 06 22:52:49 user nova-compute[75000]:       <target dev="vdc" bus="virtio"/>
Nov 06 22:52:49 user nova-compute[75000]:       <boot order="1"/>
Nov 06 22:52:49 user nova-compute[75000]:     </disk>
Nov 06 22:52:49 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:52:49 user nova-compute[75000]:       <mac address="fa:16:3e:69:c3:d6"/>
Nov 06 22:52:49 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:52:49 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:52:49 user nova-compute[75000]:       <target dev="tapc093b13d-e1"/>
Nov 06 22:52:49 user nova-compute[75000]:     </interface>
Nov 06 22:52:49 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:52:49 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/console.log" append="off"/>
Nov 06 22:52:49 user nova-compute[75000]:     </serial>
Nov 06 22:52:49 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:52:49 user nova-compute[75000]:     <video>
Nov 06 22:52:49 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:52:49 user nova-compute[75000]:     </video>
Nov 06 22:52:49 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:52:49 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:52:49 user nova-compute[75000]:     </rng>
Nov 06 22:52:49 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:52:49 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:52:49 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:52:49 user nova-compute[75000]:     </memballoon>
Nov 06 22:52:49 user nova-compute[75000]:   </devices>
Nov 06 22:52:49 user nova-compute[75000]: </domain>
Nov 06 22:52:49 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:52:49 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Instance destroyed successfully.
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:52:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] No VIF found with MAC fa:16:3e:69:c3:d6, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:52:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-5c04a2ed-5386-408f-8141-bcfcada25b4f req-2d90a5ee-0e51-44ee-a734-a4c598afd676 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:52:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5c04a2ed-5386-408f-8141-bcfcada25b4f req-2d90a5ee-0e51-44ee-a734-a4c598afd676 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5c04a2ed-5386-408f-8141-bcfcada25b4f req-2d90a5ee-0e51-44ee-a734-a4c598afd676 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5c04a2ed-5386-408f-8141-bcfcada25b4f req-2d90a5ee-0e51-44ee-a734-a4c598afd676 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-5c04a2ed-5386-408f-8141-bcfcada25b4f req-2d90a5ee-0e51-44ee-a734-a4c598afd676 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:52:51 user nova-compute[75000]: WARNING nova.compute.manager [req-5c04a2ed-5386-408f-8141-bcfcada25b4f req-2d90a5ee-0e51-44ee-a734-a4c598afd676 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state active and task_state rescuing.
Nov 06 22:52:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:52:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:52:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:52:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:52:52 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:52:52 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-02c8b703-99ed-4e0d-b88c-d0e28091655a req-084ef3f3-03dc-40e4-a597-8adfdde78f46 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-02c8b703-99ed-4e0d-b88c-d0e28091655a req-084ef3f3-03dc-40e4-a597-8adfdde78f46 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-02c8b703-99ed-4e0d-b88c-d0e28091655a req-084ef3f3-03dc-40e4-a597-8adfdde78f46 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-02c8b703-99ed-4e0d-b88c-d0e28091655a req-084ef3f3-03dc-40e4-a597-8adfdde78f46 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:52:53 user nova-compute[75000]: DEBUG nova.compute.manager [req-02c8b703-99ed-4e0d-b88c-d0e28091655a req-084ef3f3-03dc-40e4-a597-8adfdde78f46 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:52:53 user nova-compute[75000]: WARNING nova.compute.manager [req-02c8b703-99ed-4e0d-b88c-d0e28091655a req-084ef3f3-03dc-40e4-a597-8adfdde78f46 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state active and task_state rescuing.
Nov 06 22:52:54 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a51d11ff-5238-4381-9f17-6852cf81142e tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:52:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:52:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:53:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:53:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:53:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:53:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:53:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:06 user nova-compute[75000]: INFO nova.compute.manager [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Unshelving
Nov 06 22:53:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:06 user nova-compute[75000]: DEBUG nova.objects.instance [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'pci_requests' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:53:06 user nova-compute[75000]: DEBUG nova.objects.instance [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'numa_topology' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:53:06 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:53:06 user nova-compute[75000]: INFO nova.compute.claims [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Claim successful on node user
Nov 06 22:53:06 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:53:06 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:53:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:06 user nova-compute[75000]: INFO nova.network.neutron [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updating port e9674a8f-d7bf-4285-8b50-d537e1950f5a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 22:53:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:53:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquired lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:53:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:53:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-07924e79-a547-4fbe-8836-a6c52a634440 req-04357e7d-c251-42e7-8f99-54aa27d5f31d service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-changed-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:53:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-07924e79-a547-4fbe-8836-a6c52a634440 req-04357e7d-c251-42e7-8f99-54aa27d5f31d service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Refreshing instance network info cache due to event network-changed-e9674a8f-d7bf-4285-8b50-d537e1950f5a. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:53:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-07924e79-a547-4fbe-8836-a6c52a634440 req-04357e7d-c251-42e7-8f99-54aa27d5f31d service nova] Acquiring lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updating instance_info_cache with network_info: [{"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Releasing lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:53:08 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Creating image(s)
Nov 06 22:53:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG nova.objects.instance [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'trusted_certs' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-07924e79-a547-4fbe-8836-a6c52a634440 req-04357e7d-c251-42e7-8f99-54aa27d5f31d service nova] Acquired lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG nova.network.neutron [req-07924e79-a547-4fbe-8836-a6c52a634440 req-04357e7d-c251-42e7-8f99-54aa27d5f31d service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Refreshing network info cache for port e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG nova.objects.base [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<b04a54d9-a6c5-46a3-a709-929cf86a59e3> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "2c1a50f7ab46d036be5e4e2da774059058d107d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "2c1a50f7ab46d036be5e4e2da774059058d107d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:09 user nova-compute[75000]: DEBUG nova.virt.images [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] 4157d870-32e4-466d-9a96-ec4a1dd9c6b9 was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 22:53:09 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:53:09 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9.part /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-07924e79-a547-4fbe-8836-a6c52a634440 req-04357e7d-c251-42e7-8f99-54aa27d5f31d service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updated VIF entry in instance network info cache for port e9674a8f-d7bf-4285-8b50-d537e1950f5a. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:53:09 user nova-compute[75000]: DEBUG nova.network.neutron [req-07924e79-a547-4fbe-8836-a6c52a634440 req-04357e7d-c251-42e7-8f99-54aa27d5f31d service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updating instance_info_cache with network_info: [{"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:53:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-07924e79-a547-4fbe-8836-a6c52a634440 req-04357e7d-c251-42e7-8f99-54aa27d5f31d service nova] Releasing lock "refresh_cache-b04a54d9-a6c5-46a3-a709-929cf86a59e3" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9.part /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9.converted" returned: 0 in 0.550s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "2c1a50f7ab46d036be5e4e2da774059058d107d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.353s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "2c1a50f7ab46d036be5e4e2da774059058d107d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "2c1a50f7ab46d036be5e4e2da774059058d107d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9,backing_fmt=raw /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9,backing_fmt=raw /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk 1073741824" returned: 0 in 0.061s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "2c1a50f7ab46d036be5e4e2da774059058d107d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:10 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:11 user nova-compute[75000]: DEBUG nova.objects.instance [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'migration_context' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:53:11 user nova-compute[75000]: DEBUG nova.objects.base [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<b04a54d9-a6c5-46a3-a709-929cf86a59e3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:53:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Rebasing disk image.
Nov 06 22:53:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:11 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 -F raw /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 -F raw /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk" returned: 0 in 2.644s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Ensure instance console log exists: /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Start _get_guest_xml network_info=[{"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a7c6d1d4aa08850974bfc7a312614379',container_format='bare',created_at=2023-11-06T22:51:13Z,direct_url=<?>,disk_format='qcow2',id=4157d870-32e4-466d-9a96-ec4a1dd9c6b9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-209577925-shelved',owner='e9412d5020f342499289d8ad48e19ac4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T22:51:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:53:14 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:53:14 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a7c6d1d4aa08850974bfc7a312614379',container_format='bare',created_at=2023-11-06T22:51:13Z,direct_url=<?>,disk_format='qcow2',id=4157d870-32e4-466d-9a96-ec4a1dd9c6b9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-209577925-shelved',owner='e9412d5020f342499289d8ad48e19ac4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T22:51:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.objects.instance [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'vcpu_model' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.objects.base [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<b04a54d9-a6c5-46a3-a709-929cf86a59e3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-209577925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-209577925',id=43,image_ref='4157d870-32e4-466d-9a96-ec4a1dd9c6b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1151415361',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-ea9l078y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member',shelved_at='2023-11-06T22:51:18.031715',shelved_host='user',shelved_image_id='4157d870-32e4-466d-9a96-ec4a1dd9c6b9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=b04a54d9-a6c5-46a3-a709-929cf86a59e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.objects.instance [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'pci_devices' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.objects.base [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Object Instance<b04a54d9-a6c5-46a3-a709-929cf86a59e3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:53:14 user nova-compute[75000]:   <uuid>b04a54d9-a6c5-46a3-a709-929cf86a59e3</uuid>
Nov 06 22:53:14 user nova-compute[75000]:   <name>instance-0000002b</name>
Nov 06 22:53:14 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:53:14 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:53:14 user nova-compute[75000]:   <metadata>
Nov 06 22:53:14 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:53:14 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:53:14 user nova-compute[75000]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-209577925</nova:name>
Nov 06 22:53:14 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:53:14</nova:creationTime>
Nov 06 22:53:14 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:53:14 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:53:14 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:53:14 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:53:14 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:53:14 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:53:14 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:53:14 user nova-compute[75000]:       <nova:owner>
Nov 06 22:53:14 user nova-compute[75000]:         <nova:user uuid="27639ab7ae064eca9e2c1b23ded8a866">tempest-AttachVolumeShelveTestJSON-346837560-project-member</nova:user>
Nov 06 22:53:14 user nova-compute[75000]:         <nova:project uuid="e9412d5020f342499289d8ad48e19ac4">tempest-AttachVolumeShelveTestJSON-346837560</nova:project>
Nov 06 22:53:14 user nova-compute[75000]:       </nova:owner>
Nov 06 22:53:14 user nova-compute[75000]:       <nova:root type="image" uuid="4157d870-32e4-466d-9a96-ec4a1dd9c6b9"/>
Nov 06 22:53:14 user nova-compute[75000]:       <nova:ports>
Nov 06 22:53:14 user nova-compute[75000]:         <nova:port uuid="e9674a8f-d7bf-4285-8b50-d537e1950f5a">
Nov 06 22:53:14 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 22:53:14 user nova-compute[75000]:         </nova:port>
Nov 06 22:53:14 user nova-compute[75000]:       </nova:ports>
Nov 06 22:53:14 user nova-compute[75000]:     </nova:instance>
Nov 06 22:53:14 user nova-compute[75000]:   </metadata>
Nov 06 22:53:14 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:53:14 user nova-compute[75000]:     <system>
Nov 06 22:53:14 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:53:14 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:53:14 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:53:14 user nova-compute[75000]:       <entry name="serial">b04a54d9-a6c5-46a3-a709-929cf86a59e3</entry>
Nov 06 22:53:14 user nova-compute[75000]:       <entry name="uuid">b04a54d9-a6c5-46a3-a709-929cf86a59e3</entry>
Nov 06 22:53:14 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:53:14 user nova-compute[75000]:     </system>
Nov 06 22:53:14 user nova-compute[75000]:   </sysinfo>
Nov 06 22:53:14 user nova-compute[75000]:   <os>
Nov 06 22:53:14 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:53:14 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:53:14 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:53:14 user nova-compute[75000]:   </os>
Nov 06 22:53:14 user nova-compute[75000]:   <features>
Nov 06 22:53:14 user nova-compute[75000]:     <acpi/>
Nov 06 22:53:14 user nova-compute[75000]:     <apic/>
Nov 06 22:53:14 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:53:14 user nova-compute[75000]:   </features>
Nov 06 22:53:14 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:53:14 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:53:14 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:53:14 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:53:14 user nova-compute[75000]:   </clock>
Nov 06 22:53:14 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:53:14 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:53:14 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:53:14 user nova-compute[75000]:   </cpu>
Nov 06 22:53:14 user nova-compute[75000]:   <devices>
Nov 06 22:53:14 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:53:14 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:53:14 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk"/>
Nov 06 22:53:14 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:53:14 user nova-compute[75000]:     </disk>
Nov 06 22:53:14 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:53:14 user nova-compute[75000]:       <mac address="fa:16:3e:c8:99:dc"/>
Nov 06 22:53:14 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:53:14 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:53:14 user nova-compute[75000]:       <target dev="tape9674a8f-d7"/>
Nov 06 22:53:14 user nova-compute[75000]:     </interface>
Nov 06 22:53:14 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:53:14 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/console.log" append="off"/>
Nov 06 22:53:14 user nova-compute[75000]:     </serial>
Nov 06 22:53:14 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:53:14 user nova-compute[75000]:     <video>
Nov 06 22:53:14 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:53:14 user nova-compute[75000]:     </video>
Nov 06 22:53:14 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:53:14 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:53:14 user nova-compute[75000]:     </rng>
Nov 06 22:53:14 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:53:14 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:53:14 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:53:14 user nova-compute[75000]:     </memballoon>
Nov 06 22:53:14 user nova-compute[75000]:   </devices>
Nov 06 22:53:14 user nova-compute[75000]: </domain>
Nov 06 22:53:14 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-209577925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-209577925',id=43,image_ref='4157d870-32e4-466d-9a96-ec4a1dd9c6b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1151415361',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-ea9l078y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member',shelved_at='2023-11-06T22:51:18.031715',shelved_host='user',shelved_image_id='4157d870-32e4-466d-9a96-ec4a1dd9c6b9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=b04a54d9-a6c5-46a3-a709-929cf86a59e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG os_vif [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b805f5bc-421a-5848-8744-c786c55b3253', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9674a8f-d7, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9674a8f-d7, col_values=(('qos', UUID('d632248a-bb73-4e3b-859c-a33220a0cd7c')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9674a8f-d7, col_values=(('external_ids', {'iface-id': 'e9674a8f-d7bf-4285-8b50-d537e1950f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:99:dc', 'vm-uuid': 'b04a54d9-a6c5-46a3-a709-929cf86a59e3'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:14 user nova-compute[75000]: INFO os_vif [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7')
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:53:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] No VIF found with MAC fa:16:3e:c8:99:dc, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:53:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-aec92437-1017-47ef-8ee3-790ac36c0442 req-306688ce-173f-4cce-8a2b-45029db2b38a service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:53:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-aec92437-1017-47ef-8ee3-790ac36c0442 req-306688ce-173f-4cce-8a2b-45029db2b38a service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-aec92437-1017-47ef-8ee3-790ac36c0442 req-306688ce-173f-4cce-8a2b-45029db2b38a service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:15 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-aec92437-1017-47ef-8ee3-790ac36c0442 req-306688ce-173f-4cce-8a2b-45029db2b38a service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:15 user nova-compute[75000]: DEBUG nova.compute.manager [req-aec92437-1017-47ef-8ee3-790ac36c0442 req-306688ce-173f-4cce-8a2b-45029db2b38a service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:53:15 user nova-compute[75000]: WARNING nova.compute.manager [req-aec92437-1017-47ef-8ee3-790ac36c0442 req-306688ce-173f-4cce-8a2b-45029db2b38a service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 22:53:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-0f5ae782-b65f-43f0-bf24-3d4d2a90a3ee req-9742a4a4-0530-4be4-a280-8214e9c3189b service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:53:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0f5ae782-b65f-43f0-bf24-3d4d2a90a3ee req-9742a4a4-0530-4be4-a280-8214e9c3189b service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0f5ae782-b65f-43f0-bf24-3d4d2a90a3ee req-9742a4a4-0530-4be4-a280-8214e9c3189b service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0f5ae782-b65f-43f0-bf24-3d4d2a90a3ee req-9742a4a4-0530-4be4-a280-8214e9c3189b service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:17 user nova-compute[75000]: DEBUG nova.compute.manager [req-0f5ae782-b65f-43f0-bf24-3d4d2a90a3ee req-9742a4a4-0530-4be4-a280-8214e9c3189b service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:53:17 user nova-compute[75000]: WARNING nova.compute.manager [req-0f5ae782-b65f-43f0-bf24-3d4d2a90a3ee req-9742a4a4-0530-4be4-a280-8214e9c3189b service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 22:53:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:53:18 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:53:18 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance spawned successfully.
Nov 06 22:53:18 user nova-compute[75000]: DEBUG nova.compute.manager [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:53:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-14b2d313-ef4e-49aa-ae56-dce2b6da2784 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.471s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:53:36 user nova-compute[75000]: INFO nova.compute.claims [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Claim successful on node user
Nov 06 22:53:36 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG nova.network.neutron [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:53:36 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:53:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG nova.policy [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d4aa96179fd4121ba224f47c01d9364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828fc01bb744496f83bd0f5d90e6924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:53:36 user nova-compute[75000]: INFO nova.virt.block_device [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Booting with volume 0a1d51ea-511b-45a7-97bd-6e335ccbcafa at /dev/vda
Nov 06 22:53:36 user nova-compute[75000]: DEBUG os_brick.utils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:53:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cf5e89-394c-4472-8ec3-7138b4d03250]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc02cfde-f8e0-4852-8e2e-cd693f6ecd07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[61794114-a1ef-4734-978b-fc17d46c8cfe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9bc863-003d-45e9-b26d-791f85711bd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:53:37 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:53:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c6ce45-75c4-41e8-b892-c974ac337145]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG os_brick.utils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Updating existing volume attachment record: 1b5f6424-e346-42f0-af75-34e12e8f454f {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Successfully created port: d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Successfully updated port: d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "refresh_cache-a29614f7-abdb-42cb-b40f-9cf3fac0913d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquired lock "refresh_cache-a29614f7-abdb-42cb-b40f-9cf3fac0913d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-3d2ff508-e04b-47d7-9d7e-41c0b02b1774 req-c13be1d8-a484-4632-baa8-ad4531ee39d0 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received event network-changed-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-3d2ff508-e04b-47d7-9d7e-41c0b02b1774 req-c13be1d8-a484-4632-baa8-ad4531ee39d0 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Refreshing instance network info cache due to event network-changed-d785b0df-9954-49ea-b0d7-312a00621a5c. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3d2ff508-e04b-47d7-9d7e-41c0b02b1774 req-c13be1d8-a484-4632-baa8-ad4531ee39d0 service nova] Acquiring lock "refresh_cache-a29614f7-abdb-42cb-b40f-9cf3fac0913d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Updating instance_info_cache with network_info: [{"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Releasing lock "refresh_cache-a29614f7-abdb-42cb-b40f-9cf3fac0913d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Instance network_info: |[{"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3d2ff508-e04b-47d7-9d7e-41c0b02b1774 req-c13be1d8-a484-4632-baa8-ad4531ee39d0 service nova] Acquired lock "refresh_cache-a29614f7-abdb-42cb-b40f-9cf3fac0913d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:53:38 user nova-compute[75000]: DEBUG nova.network.neutron [req-3d2ff508-e04b-47d7-9d7e-41c0b02b1774 req-c13be1d8-a484-4632-baa8-ad4531ee39d0 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Refreshing network info cache for port d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:53:39 user nova-compute[75000]: DEBUG nova.network.neutron [req-3d2ff508-e04b-47d7-9d7e-41c0b02b1774 req-c13be1d8-a484-4632-baa8-ad4531ee39d0 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Updated VIF entry in instance network info cache for port d785b0df-9954-49ea-b0d7-312a00621a5c. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:53:39 user nova-compute[75000]: DEBUG nova.network.neutron [req-3d2ff508-e04b-47d7-9d7e-41c0b02b1774 req-c13be1d8-a484-4632-baa8-ad4531ee39d0 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Updating instance_info_cache with network_info: [{"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:53:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3d2ff508-e04b-47d7-9d7e-41c0b02b1774 req-c13be1d8-a484-4632-baa8-ad4531ee39d0 service nova] Releasing lock "refresh_cache-a29614f7-abdb-42cb-b40f-9cf3fac0913d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:53:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-1c6fe362-ba3d-4926-8afa-70905af5de3d req-5b05e68f-33d7-4722-9424-0bf7aa37c266 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-1c6fe362-ba3d-4926-8afa-70905af5de3d req-5b05e68f-33d7-4722-9424-0bf7aa37c266 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing instance network info cache due to event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1c6fe362-ba3d-4926-8afa-70905af5de3d req-5b05e68f-33d7-4722-9424-0bf7aa37c266 service nova] Acquiring lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1c6fe362-ba3d-4926-8afa-70905af5de3d req-5b05e68f-33d7-4722-9424-0bf7aa37c266 service nova] Acquired lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-1c6fe362-ba3d-4926-8afa-70905af5de3d req-5b05e68f-33d7-4722-9424-0bf7aa37c266 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-1c6fe362-ba3d-4926-8afa-70905af5de3d req-5b05e68f-33d7-4722-9424-0bf7aa37c266 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updated VIF entry in instance network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-1c6fe362-ba3d-4926-8afa-70905af5de3d req-5b05e68f-33d7-4722-9424-0bf7aa37c266 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1c6fe362-ba3d-4926-8afa-70905af5de3d req-5b05e68f-33d7-4722-9424-0bf7aa37c266 service nova] Releasing lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:41 user nova-compute[75000]: INFO nova.compute.manager [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Shelve offloading
Nov 06 22:53:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-0ab1d6d0-f1d6-4b2b-b1b5-5dfcb34aefde req-0214f6a3-236f-4d61-b896-65db1b46e829 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-unplugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0ab1d6d0-f1d6-4b2b-b1b5-5dfcb34aefde req-0214f6a3-236f-4d61-b896-65db1b46e829 service nova] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0ab1d6d0-f1d6-4b2b-b1b5-5dfcb34aefde req-0214f6a3-236f-4d61-b896-65db1b46e829 service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0ab1d6d0-f1d6-4b2b-b1b5-5dfcb34aefde req-0214f6a3-236f-4d61-b896-65db1b46e829 service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-0ab1d6d0-f1d6-4b2b-b1b5-5dfcb34aefde req-0214f6a3-236f-4d61-b896-65db1b46e829 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] No waiting events found dispatching network-vif-unplugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:53:42 user nova-compute[75000]: WARNING nova.compute.manager [req-0ab1d6d0-f1d6-4b2b-b1b5-5dfcb34aefde req-0214f6a3-236f-4d61-b896-65db1b46e829 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received unexpected event network-vif-unplugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 for instance with vm_state active and task_state shelving.
Nov 06 22:53:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Instance destroyed successfully.
Nov 06 22:53:42 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquired lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG nova.network.neutron [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:53:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Releasing lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:53:43 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Instance destroyed successfully.
Nov 06 22:53:43 user nova-compute[75000]: DEBUG nova.objects.instance [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lazy-loading 'resources' on Instance uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581049709',display_name='tempest-TestShelveInstance-server-1581049709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581049709',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa+B84ATE/Y1pAOrul2P50e3pxv5IgVKs//Oid+onZBjofnCj7owKSgnbJwFnVEPZG/dGtvVBVDnWfud7yQMSM4afz51CQob0ROvPi1xMY3DFpVCyaJUgcNPpqiBg0dSA==',key_name='tempest-TestShelveInstance-1442804575',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:52:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67f638f4062f446fadaee2a3bae01e1a',ramdisk_id='',reservation_id='r-t0vw700y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1271715636',owner_user_name='tempest-TestShelveInstance-1271715636-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:52:19Z,user_data=None,user_id='2b32b1bcaeb147338db1e30c98d45cef',uuid=1f5ad59e-3dfa-40f2-b3bc-27d9b2514495,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converting VIF {"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_vif [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b8ac5f3-39, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG nova.compute.manager [req-1f735cca-cddf-43aa-a989-9b35f33d1619 req-ab3bbef7-2cf6-4628-a6d9-989b204775de service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG nova.compute.manager [req-1f735cca-cddf-43aa-a989-9b35f33d1619 req-ab3bbef7-2cf6-4628-a6d9-989b204775de service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing instance network info cache due to event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1f735cca-cddf-43aa-a989-9b35f33d1619 req-ab3bbef7-2cf6-4628-a6d9-989b204775de service nova] Acquiring lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1f735cca-cddf-43aa-a989-9b35f33d1619 req-ab3bbef7-2cf6-4628-a6d9-989b204775de service nova] Acquired lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG nova.network.neutron [req-1f735cca-cddf-43aa-a989-9b35f33d1619 req-ab3bbef7-2cf6-4628-a6d9-989b204775de service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25eb7ce8-2a06-4b45-8bbf-031502af152e) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:43 user nova-compute[75000]: INFO os_vif [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39')
Nov 06 22:53:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmapSoxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:53:43 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fddb810-8018-4c39-9414-65a9ce87bee5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:53:43 user nova-compute[75000]: No targets found.
Nov 06 22:53:43 user nova-compute[75000]: iSNS:
Nov 06 22:53:43 user nova-compute[75000]: No targets found.
Nov 06 22:53:43 user nova-compute[75000]: STATIC:
Nov 06 22:53:43 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8
Nov 06 22:53:43 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:53:43 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:53:43 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b
Nov 06 22:53:43 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:53:43 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:53:43 user nova-compute[75000]: FIRMWARE:
Nov 06 22:53:43 user nova-compute[75000]: No targets found.
Nov 06 22:53:43 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:53:43 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:53:43 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8be47b-b74e-4e75-9293-0d0f01a29293]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a3bfe6-5f05-4182-8cc8-efb8035caf3a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:53:43 user nova-compute[75000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:53:43 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:53:43 user nova-compute[75000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:53:43 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc294430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b2e9f1-5cc9-4444-9d50-91c803168876]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce2810f-0a1d-4416-b688-889852a770db]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a58027b-8184-4943-b5c9-3eb6f5bbea05]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8803f1b-06ff-4ef9-bd5b-8ab4840f0e58]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[034272b9-31de-4a55-81cb-ef9a5bfb0681]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[318bc3e6-3d07-46b0-8f8c-1bd2182a3565]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260]
Nov 06 22:53:43 user nova-compute[75000]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260] successful.
Nov 06 22:53:43 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c460c3-863b-45ea-abe3-b81b3d1251f2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] <== disconnect_volume: return (313ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:53:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:53:43 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Deleting instance files /opt/stack/data/nova/instances/1f5ad59e-3dfa-40f2-b3bc-27d9b2514495_del
Nov 06 22:53:43 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Deletion of /opt/stack/data/nova/instances/1f5ad59e-3dfa-40f2-b3bc-27d9b2514495_del complete
Nov 06 22:53:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-1f735cca-cddf-43aa-a989-9b35f33d1619 req-ab3bbef7-2cf6-4628-a6d9-989b204775de service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updated VIF entry in instance network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:53:44 user nova-compute[75000]: DEBUG nova.network.neutron [req-1f735cca-cddf-43aa-a989-9b35f33d1619 req-ab3bbef7-2cf6-4628-a6d9-989b204775de service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": null, "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:53:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1f735cca-cddf-43aa-a989-9b35f33d1619 req-ab3bbef7-2cf6-4628-a6d9-989b204775de service nova] Releasing lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:53:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-50d03a0a-e799-44c7-8f38-d0665d0be9ae req-d0582ac9-85d3-4601-9736-73cab9477d1a service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:53:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-50d03a0a-e799-44c7-8f38-d0665d0be9ae req-d0582ac9-85d3-4601-9736-73cab9477d1a service nova] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-50d03a0a-e799-44c7-8f38-d0665d0be9ae req-d0582ac9-85d3-4601-9736-73cab9477d1a service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-50d03a0a-e799-44c7-8f38-d0665d0be9ae req-d0582ac9-85d3-4601-9736-73cab9477d1a service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-50d03a0a-e799-44c7-8f38-d0665d0be9ae req-d0582ac9-85d3-4601-9736-73cab9477d1a service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] No waiting events found dispatching network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:53:44 user nova-compute[75000]: WARNING nova.compute.manager [req-50d03a0a-e799-44c7-8f38-d0665d0be9ae req-d0582ac9-85d3-4601-9736-73cab9477d1a service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received unexpected event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 for instance with vm_state active and task_state shelving.
Nov 06 22:53:45 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Deleted allocations for instance 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495
Nov 06 22:53:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:45 user nova-compute[75000]: DEBUG nova.objects.instance [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:53:45 user nova-compute[75000]: DEBUG nova.objects.base [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Object Instance<1f5ad59e-3dfa-40f2-b3bc-27d9b2514495> lazy-loaded attributes: resources,numa_topology {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:53:45 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:53:45 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:53:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5e437cb8-66e6-4ec9-a97b-b6fd41737f33 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.007s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:46 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:47 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.rescue --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:48 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:53:48 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:53:48 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=24.925979614257812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b04a54d9-a6c5-46a3-a709-929cf86a59e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance a29614f7-abdb-42cb-b40f-9cf3fac0913d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:53:48 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:53:49 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:53:49 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:53:49 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:53:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:53:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:53:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:53:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:53:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 06 22:53:51 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 22:53:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:53:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:53:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:53:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:54 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:53:54 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:53:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:53:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:54:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Creating image(s)
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Ensure instance console log exists: /opt/stack/data/nova/instances/a29614f7-abdb-42cb-b40f-9cf3fac0913d/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Start _get_guest_xml network_info=[{"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhsKlar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a29614f7-abdb-42cb-b40f-9cf3fac0913d', 'attached_at': '', 'detached_at': '', 'volume_id': '0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'serial': '0a1d51ea-511b-45a7-97bd-6e335ccbcafa'}, 'attachment_id': '1b5f6424-e346-42f0-af75-34e12e8f454f', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:54:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:54:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhsKlar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:54:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:54:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:54:01 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1263a842-100f-421d-8201-f2b5ae05020c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:54:01 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[216190e9-c4d3-44bd-9fe1-cb50a814ec4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa] added
Nov 06 22:54:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d189c4c7-55d1-4fe9-9746-832648cabefc]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2713707a-3f7f-4141-a121-0e727b13112e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbhsKlar {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbhsKlar" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ca7571-e760-4309-92c0-1d2b46bb4292]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MbhsKlar'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1c0a99-3ef4-436d-8e6c-24cd4b282292]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6156c46-cff8-40c8-a3b8-eb8dbba348bf]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccc53e8-fb6d-4bfe-80c8-b34c4cd56440 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:54:01 user nova-compute[75000]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccc53e8-fb6d-4bfe-80c8-b34c4cd56440 (non-flash)
Nov 06 22:54:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:54:01 user nova-compute[75000]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccc53e8-fb6d-4bfe-80c8-b34c4cd56440 (non-flash)
Nov 06 22:54:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[675c010c-0add-4c99-9a34-b2e189a4130a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260]
Nov 06 22:54:01 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260] successful.
Nov 06 22:54:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[098da38a-e320-42e7-83a9-538ab5e4612c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2612d7f7-c2e8-4704-a472-7bf13fed78b0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccc53e8-fb6d-4bfe-80c8-b34c4cd56440 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:54:01 user nova-compute[75000]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccc53e8-fb6d-4bfe-80c8-b34c4cd56440 (non-flash)
Nov 06 22:54:01 user nova-compute[75000]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:54:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:54:01 user nova-compute[75000]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ccc53e8-fb6d-4bfe-80c8-b34c4cd56440 (non-flash)
Nov 06 22:54:01 user nova-compute[75000]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:54:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aac86c-5215-4439-82e3-21e0c3fc42e6]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:54:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhsKlar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26365366132393936', 'path': '/dev/sdd'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365366132393936', 'path': '/dev/sdd'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1036587047',display_name='tempest-TestVolumeBootPattern-server-1036587047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1036587047',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D/OAM/5YQAe11VPWv8oDc0xABKrvuAtt9KaN2spjr6XWdYKHlrJcCG8nUWAFETQvI9+ZcAWQjE9tlmsCZUTn3BwjK26nFHLyNit9WqhgP3juOx/+esRcOlreI5rjf3Q==',key_name='tempest-TestVolumeBootPattern-881632780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-59euj89v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:53:37Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=a29614f7-abdb-42cb-b40f-9cf3fac0913d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:91:85,bridge_name='br-int',has_traffic_filtering=True,id=d785b0df-9954-49ea-b0d7-312a00621a5c,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd785b0df-99') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG nova.objects.instance [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'pci_devices' on Instance uuid a29614f7-abdb-42cb-b40f-9cf3fac0913d {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:54:02 user nova-compute[75000]:   <uuid>a29614f7-abdb-42cb-b40f-9cf3fac0913d</uuid>
Nov 06 22:54:02 user nova-compute[75000]:   <name>instance-0000002d</name>
Nov 06 22:54:02 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:54:02 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:54:02 user nova-compute[75000]:   <metadata>
Nov 06 22:54:02 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:54:02 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:54:02 user nova-compute[75000]:       <nova:name>tempest-TestVolumeBootPattern-server-1036587047</nova:name>
Nov 06 22:54:02 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:54:01</nova:creationTime>
Nov 06 22:54:02 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:54:02 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:54:02 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:54:02 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:54:02 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:54:02 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:54:02 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:54:02 user nova-compute[75000]:       <nova:owner>
Nov 06 22:54:02 user nova-compute[75000]:         <nova:user uuid="0d4aa96179fd4121ba224f47c01d9364">tempest-TestVolumeBootPattern-673062967-project-member</nova:user>
Nov 06 22:54:02 user nova-compute[75000]:         <nova:project uuid="828fc01bb744496f83bd0f5d90e6924f">tempest-TestVolumeBootPattern-673062967</nova:project>
Nov 06 22:54:02 user nova-compute[75000]:       </nova:owner>
Nov 06 22:54:02 user nova-compute[75000]:       <nova:ports>
Nov 06 22:54:02 user nova-compute[75000]:         <nova:port uuid="d785b0df-9954-49ea-b0d7-312a00621a5c">
Nov 06 22:54:02 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 22:54:02 user nova-compute[75000]:         </nova:port>
Nov 06 22:54:02 user nova-compute[75000]:       </nova:ports>
Nov 06 22:54:02 user nova-compute[75000]:     </nova:instance>
Nov 06 22:54:02 user nova-compute[75000]:   </metadata>
Nov 06 22:54:02 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:54:02 user nova-compute[75000]:     <system>
Nov 06 22:54:02 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:54:02 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:54:02 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:54:02 user nova-compute[75000]:       <entry name="serial">a29614f7-abdb-42cb-b40f-9cf3fac0913d</entry>
Nov 06 22:54:02 user nova-compute[75000]:       <entry name="uuid">a29614f7-abdb-42cb-b40f-9cf3fac0913d</entry>
Nov 06 22:54:02 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:54:02 user nova-compute[75000]:     </system>
Nov 06 22:54:02 user nova-compute[75000]:   </sysinfo>
Nov 06 22:54:02 user nova-compute[75000]:   <os>
Nov 06 22:54:02 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:54:02 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:54:02 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:54:02 user nova-compute[75000]:   </os>
Nov 06 22:54:02 user nova-compute[75000]:   <features>
Nov 06 22:54:02 user nova-compute[75000]:     <acpi/>
Nov 06 22:54:02 user nova-compute[75000]:     <apic/>
Nov 06 22:54:02 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:54:02 user nova-compute[75000]:   </features>
Nov 06 22:54:02 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:54:02 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:54:02 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:54:02 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:54:02 user nova-compute[75000]:   </clock>
Nov 06 22:54:02 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:54:02 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:54:02 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:54:02 user nova-compute[75000]:   </cpu>
Nov 06 22:54:02 user nova-compute[75000]:   <devices>
Nov 06 22:54:02 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:54:02 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:54:02 user nova-compute[75000]:       <source dev="/dev/sdd"/>
Nov 06 22:54:02 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:54:02 user nova-compute[75000]:       <serial>0a1d51ea-511b-45a7-97bd-6e335ccbcafa</serial>
Nov 06 22:54:02 user nova-compute[75000]:     </disk>
Nov 06 22:54:02 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:54:02 user nova-compute[75000]:       <mac address="fa:16:3e:cb:91:85"/>
Nov 06 22:54:02 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:54:02 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:54:02 user nova-compute[75000]:       <target dev="tapd785b0df-99"/>
Nov 06 22:54:02 user nova-compute[75000]:     </interface>
Nov 06 22:54:02 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:54:02 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/a29614f7-abdb-42cb-b40f-9cf3fac0913d/console.log" append="off"/>
Nov 06 22:54:02 user nova-compute[75000]:     </serial>
Nov 06 22:54:02 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:54:02 user nova-compute[75000]:     <video>
Nov 06 22:54:02 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:54:02 user nova-compute[75000]:     </video>
Nov 06 22:54:02 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:54:02 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:54:02 user nova-compute[75000]:     </rng>
Nov 06 22:54:02 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:54:02 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:54:02 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:54:02 user nova-compute[75000]:     </memballoon>
Nov 06 22:54:02 user nova-compute[75000]:   </devices>
Nov 06 22:54:02 user nova-compute[75000]: </domain>
Nov 06 22:54:02 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1036587047',display_name='tempest-TestVolumeBootPattern-server-1036587047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1036587047',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D/OAM/5YQAe11VPWv8oDc0xABKrvuAtt9KaN2spjr6XWdYKHlrJcCG8nUWAFETQvI9+ZcAWQjE9tlmsCZUTn3BwjK26nFHLyNit9WqhgP3juOx/+esRcOlreI5rjf3Q==',key_name='tempest-TestVolumeBootPattern-881632780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-59euj89v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:53:37Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=a29614f7-abdb-42cb-b40f-9cf3fac0913d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:91:85,bridge_name='br-int',has_traffic_filtering=True,id=d785b0df-9954-49ea-b0d7-312a00621a5c,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd785b0df-99') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG os_vif [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:91:85,bridge_name='br-int',has_traffic_filtering=True,id=d785b0df-9954-49ea-b0d7-312a00621a5c,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd785b0df-99') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ac0703a-3333-558c-b4f0-8ed001fd4973', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd785b0df-99, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd785b0df-99, col_values=(('qos', UUID('a953b496-d338-4c8e-904a-98942e547af8')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd785b0df-99, col_values=(('external_ids', {'iface-id': 'd785b0df-9954-49ea-b0d7-312a00621a5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:91:85', 'vm-uuid': 'a29614f7-abdb-42cb-b40f-9cf3fac0913d'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:54:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:54:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:03 user nova-compute[75000]: INFO os_vif [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:91:85,bridge_name='br-int',has_traffic_filtering=True,id=d785b0df-9954-49ea-b0d7-312a00621a5c,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd785b0df-99')
Nov 06 22:54:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:54:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No VIF found with MAC fa:16:3e:cb:91:85, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:54:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-f7cba131-6eac-4c11-9eb3-51b226a205f5 req-2aae1e51-22c5-4010-bdf1-e9f31d4cb6b9 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received event network-vif-plugged-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f7cba131-6eac-4c11-9eb3-51b226a205f5 req-2aae1e51-22c5-4010-bdf1-e9f31d4cb6b9 service nova] Acquiring lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f7cba131-6eac-4c11-9eb3-51b226a205f5 req-2aae1e51-22c5-4010-bdf1-e9f31d4cb6b9 service nova] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f7cba131-6eac-4c11-9eb3-51b226a205f5 req-2aae1e51-22c5-4010-bdf1-e9f31d4cb6b9 service nova] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-f7cba131-6eac-4c11-9eb3-51b226a205f5 req-2aae1e51-22c5-4010-bdf1-e9f31d4cb6b9 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] No waiting events found dispatching network-vif-plugged-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:04 user nova-compute[75000]: WARNING nova.compute.manager [req-f7cba131-6eac-4c11-9eb3-51b226a205f5 req-2aae1e51-22c5-4010-bdf1-e9f31d4cb6b9 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received unexpected event network-vif-plugged-d785b0df-9954-49ea-b0d7-312a00621a5c for instance with vm_state building and task_state spawning.
Nov 06 22:54:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:54:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Instance spawned successfully.
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.compute.manager [req-0beb4cbd-8996-427c-a1a6-00d4ad2cd27f req-c43b2387-1ddc-4f28-8699-40428c86a989 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received event network-vif-plugged-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0beb4cbd-8996-427c-a1a6-00d4ad2cd27f req-c43b2387-1ddc-4f28-8699-40428c86a989 service nova] Acquiring lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0beb4cbd-8996-427c-a1a6-00d4ad2cd27f req-c43b2387-1ddc-4f28-8699-40428c86a989 service nova] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0beb4cbd-8996-427c-a1a6-00d4ad2cd27f req-c43b2387-1ddc-4f28-8699-40428c86a989 service nova] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.compute.manager [req-0beb4cbd-8996-427c-a1a6-00d4ad2cd27f req-c43b2387-1ddc-4f28-8699-40428c86a989 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] No waiting events found dispatching network-vif-plugged-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:06 user nova-compute[75000]: WARNING nova.compute.manager [req-0beb4cbd-8996-427c-a1a6-00d4ad2cd27f req-c43b2387-1ddc-4f28-8699-40428c86a989 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received unexpected event network-vif-plugged-d785b0df-9954-49ea-b0d7-312a00621a5c for instance with vm_state building and task_state spawning.
Nov 06 22:54:06 user nova-compute[75000]: INFO nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 06 22:54:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:54:07 user nova-compute[75000]: INFO nova.compute.manager [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Took 30.75 seconds to build instance.
Nov 06 22:54:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-24731e85-b582-4a8e-81f2-00b74a3a8635 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.861s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:07 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:36 user nova-compute[75000]: INFO nova.compute.manager [None req-3584ca0e-689c-4497-89fd-b8419f61273a tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Unrescuing
Nov 06 22:54:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3584ca0e-689c-4497-89fd-b8419f61273a tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3584ca0e-689c-4497-89fd-b8419f61273a tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG nova.network.neutron [None req-3584ca0e-689c-4497-89fd-b8419f61273a tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG nova.network.neutron [None req-3584ca0e-689c-4497-89fd-b8419f61273a tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-3584ca0e-689c-4497-89fd-b8419f61273a tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG nova.objects.instance [None req-3584ca0e-689c-4497-89fd-b8419f61273a tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'flavor' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-1122825c-34a4-40b9-b083-1645d536525a req-cdad64e0-4e87-4c24-a035-74dbc1608932 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-unplugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1122825c-34a4-40b9-b083-1645d536525a req-cdad64e0-4e87-4c24-a035-74dbc1608932 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1122825c-34a4-40b9-b083-1645d536525a req-cdad64e0-4e87-4c24-a035-74dbc1608932 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-1122825c-34a4-40b9-b083-1645d536525a req-cdad64e0-4e87-4c24-a035-74dbc1608932 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-1122825c-34a4-40b9-b083-1645d536525a req-cdad64e0-4e87-4c24-a035-74dbc1608932 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-unplugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:37 user nova-compute[75000]: WARNING nova.compute.manager [req-1122825c-34a4-40b9-b083-1645d536525a req-cdad64e0-4e87-4c24-a035-74dbc1608932 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-unplugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:54:37 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Instance destroyed successfully.
Nov 06 22:54:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-4bf08f67-a74b-4658-9428-d4872853a972 req-d2fc13dd-e41d-4ddb-8dc1-962a736870a7 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-changed-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:37 user nova-compute[75000]: DEBUG nova.compute.manager [req-4bf08f67-a74b-4658-9428-d4872853a972 req-d2fc13dd-e41d-4ddb-8dc1-962a736870a7 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Refreshing instance network info cache due to event network-changed-c093b13d-e15d-4272-a9a0-23aa4f229e44. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:54:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4bf08f67-a74b-4658-9428-d4872853a972 req-d2fc13dd-e41d-4ddb-8dc1-962a736870a7 service nova] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:54:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4bf08f67-a74b-4658-9428-d4872853a972 req-d2fc13dd-e41d-4ddb-8dc1-962a736870a7 service nova] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:54:37 user nova-compute[75000]: DEBUG nova.network.neutron [req-4bf08f67-a74b-4658-9428-d4872853a972 req-d2fc13dd-e41d-4ddb-8dc1-962a736870a7 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Refreshing network info cache for port c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:54:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:38 user nova-compute[75000]: DEBUG nova.network.neutron [req-4bf08f67-a74b-4658-9428-d4872853a972 req-d2fc13dd-e41d-4ddb-8dc1-962a736870a7 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updated VIF entry in instance network info cache for port c093b13d-e15d-4272-a9a0-23aa4f229e44. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:54:38 user nova-compute[75000]: DEBUG nova.network.neutron [req-4bf08f67-a74b-4658-9428-d4872853a972 req-d2fc13dd-e41d-4ddb-8dc1-962a736870a7 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:54:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4bf08f67-a74b-4658-9428-d4872853a972 req-d2fc13dd-e41d-4ddb-8dc1-962a736870a7 service nova] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:39 user nova-compute[75000]: WARNING nova.compute.manager [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:54:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:39 user nova-compute[75000]: WARNING nova.compute.manager [req-7c6f8060-c988-4f2c-944f-df48d06b76f6 req-a56a6675-8697-439f-9228-0b54a8ee6074 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state rescued and task_state unrescuing.
Nov 06 22:54:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-530ad8da-7f88-4875-81bb-2812f4f85617 req-717440f1-2bd5-4a9c-a972-a67f170508b6 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-changed-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-530ad8da-7f88-4875-81bb-2812f4f85617 req-717440f1-2bd5-4a9c-a972-a67f170508b6 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Refreshing instance network info cache due to event network-changed-c093b13d-e15d-4272-a9a0-23aa4f229e44. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-530ad8da-7f88-4875-81bb-2812f4f85617 req-717440f1-2bd5-4a9c-a972-a67f170508b6 service nova] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-530ad8da-7f88-4875-81bb-2812f4f85617 req-717440f1-2bd5-4a9c-a972-a67f170508b6 service nova] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:54:39 user nova-compute[75000]: DEBUG nova.network.neutron [req-530ad8da-7f88-4875-81bb-2812f4f85617 req-717440f1-2bd5-4a9c-a972-a67f170508b6 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Refreshing network info cache for port c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:54:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-530ad8da-7f88-4875-81bb-2812f4f85617 req-717440f1-2bd5-4a9c-a972-a67f170508b6 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updated VIF entry in instance network info cache for port c093b13d-e15d-4272-a9a0-23aa4f229e44. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:54:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-530ad8da-7f88-4875-81bb-2812f4f85617 req-717440f1-2bd5-4a9c-a972-a67f170508b6 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:54:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-530ad8da-7f88-4875-81bb-2812f4f85617 req-717440f1-2bd5-4a9c-a972-a67f170508b6 service nova] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:54:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-3584ca0e-689c-4497-89fd-b8419f61273a tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:54:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-9af33082-0ab9-4895-b6df-ea96bc0b1129 req-30d05ad3-a02a-4f1b-84b0-85e422825007 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9af33082-0ab9-4895-b6df-ea96bc0b1129 req-30d05ad3-a02a-4f1b-84b0-85e422825007 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9af33082-0ab9-4895-b6df-ea96bc0b1129 req-30d05ad3-a02a-4f1b-84b0-85e422825007 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9af33082-0ab9-4895-b6df-ea96bc0b1129 req-30d05ad3-a02a-4f1b-84b0-85e422825007 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-9af33082-0ab9-4895-b6df-ea96bc0b1129 req-30d05ad3-a02a-4f1b-84b0-85e422825007 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:41 user nova-compute[75000]: WARNING nova.compute.manager [req-9af33082-0ab9-4895-b6df-ea96bc0b1129 req-30d05ad3-a02a-4f1b-84b0-85e422825007 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state active and task_state None.
Nov 06 22:54:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:47 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:48 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:49 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:54:50 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:54:50 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:54:50 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8480MB free_disk=24.922622680664062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b04a54d9-a6c5-46a3-a709-929cf86a59e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance a29614f7-abdb-42cb-b40f-9cf3fac0913d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:54:50 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:54:51 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:54:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:54:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [{"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:54 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:56 user nova-compute[75000]: INFO nova.compute.manager [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Terminating instance
Nov 06 22:54:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-b2e5186f-eafa-48be-b538-c0de88666240 req-4984f06f-d6ec-4f4c-af47-cdbe8854122c service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-unplugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b2e5186f-eafa-48be-b538-c0de88666240 req-4984f06f-d6ec-4f4c-af47-cdbe8854122c service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b2e5186f-eafa-48be-b538-c0de88666240 req-4984f06f-d6ec-4f4c-af47-cdbe8854122c service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b2e5186f-eafa-48be-b538-c0de88666240 req-4984f06f-d6ec-4f4c-af47-cdbe8854122c service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-b2e5186f-eafa-48be-b538-c0de88666240 req-4984f06f-d6ec-4f4c-af47-cdbe8854122c service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-unplugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-b2e5186f-eafa-48be-b538-c0de88666240 req-4984f06f-d6ec-4f4c-af47-cdbe8854122c service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-unplugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:54:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Instance destroyed successfully.
Nov 06 22:54:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lazy-loading 'resources' on Instance uuid b04a54d9-a6c5-46a3-a709-929cf86a59e3 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:49:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-209577925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-209577925',id=43,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrES4qw0nR1lLXFRqevIQMp6bQWTTgmS5ngDzksjryuVEm4Ftg62UKG9Dhb6PlTaUhAGsmLa10P1f5VwBxliCoe1FTmxoBR6fUQ4nIsI31j5LQqMd10peGauFL4yr2Z6w==',key_name='tempest-keypair-1151415361',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9412d5020f342499289d8ad48e19ac4',ramdisk_id='',reservation_id='r-ea9l078y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-346837560',owner_user_name='tempest-AttachVolumeShelveTestJSON-346837560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27639ab7ae064eca9e2c1b23ded8a866',uuid=b04a54d9-a6c5-46a3-a709-929cf86a59e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converting VIF {"id": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "address": "fa:16:3e:c8:99:dc", "network": {"id": "7e3360d0-744c-4a21-921e-d86c21a0a347", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1729583639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9412d5020f342499289d8ad48e19ac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9674a8f-d7", "ovs_interfaceid": "e9674a8f-d7bf-4285-8b50-d537e1950f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG os_vif [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9674a8f-d7, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d632248a-bb73-4e3b-859c-a33220a0cd7c) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: INFO os_vif [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:99:dc,bridge_name='br-int',has_traffic_filtering=True,id=e9674a8f-d7bf-4285-8b50-d537e1950f5a,network=Network(7e3360d0-744c-4a21-921e-d86c21a0a347),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9674a8f-d7')
Nov 06 22:54:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Deleting instance files /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3_del
Nov 06 22:54:57 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Deletion of /opt/stack/data/nova/instances/b04a54d9-a6c5-46a3-a709-929cf86a59e3_del complete
Nov 06 22:54:57 user nova-compute[75000]: INFO nova.compute.manager [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 22:54:57 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:54:58 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Took 1.19 seconds to deallocate network for instance.
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:58 user nova-compute[75000]: WARNING nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state deleted and task_state None.
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:58 user nova-compute[75000]: WARNING nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state deleted and task_state None.
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:58 user nova-compute[75000]: WARNING nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state deleted and task_state None.
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-unplugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-unplugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:58 user nova-compute[75000]: WARNING nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-unplugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state deleted and task_state None.
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Acquiring lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] No waiting events found dispatching network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:54:58 user nova-compute[75000]: WARNING nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received unexpected event network-vif-plugged-e9674a8f-d7bf-4285-8b50-d537e1950f5a for instance with vm_state deleted and task_state None.
Nov 06 22:54:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-078871fa-9777-4e4a-a43a-e20955f68f76 req-4a631efa-cdb3-46a9-ab84-2ea663ddc4c0 service nova] [instance: b04a54d9-a6c5-46a3-a709-929cf86a59e3] Received event network-vif-deleted-e9674a8f-d7bf-4285-8b50-d537e1950f5a {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:54:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:54:58 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Deleted allocations for instance b04a54d9-a6c5-46a3-a709-929cf86a59e3
Nov 06 22:54:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e3e7e5ad-9fba-47e8-8bb5-ed4a5999b059 tempest-AttachVolumeShelveTestJSON-346837560 tempest-AttachVolumeShelveTestJSON-346837560-project-member] Lock "b04a54d9-a6c5-46a3-a709-929cf86a59e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.537s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:09 user nova-compute[75000]: INFO nova.compute.manager [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Detaching volume db5b1519-f71d-455a-8c49-283a683852c8
Nov 06 22:55:09 user nova-compute[75000]: INFO nova.virt.block_device [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Attempting to driver detach volume db5b1519-f71d-455a-8c49-283a683852c8 from mountpoint /dev/vdb
Nov 06 22:55:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Attempting to detach device vdb from instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 22:55:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:55:09 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:55:09 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:55:09 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:55:09 user nova-compute[75000]:   <serial>db5b1519-f71d-455a-8c49-283a683852c8</serial>
Nov 06 22:55:09 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:55:09 user nova-compute[75000]: </disk>
Nov 06 22:55:09 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:55:09 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Successfully detached device vdb from instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb from the persistent domain config.
Nov 06 22:55:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 22:55:09 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 22:55:09 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:55:09 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 22:55:09 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 22:55:09 user nova-compute[75000]:   <serial>db5b1519-f71d-455a-8c49-283a683852c8</serial>
Nov 06 22:55:09 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 22:55:09 user nova-compute[75000]: </disk>
Nov 06 22:55:09 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 22:55:10 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 22:55:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:55:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-b9542744-a03e-49ae-a3f5-5aa0f54e67d0 req-21491d49-f165-4210-b395-af4bd426b902 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received event network-changed-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:55:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-b9542744-a03e-49ae-a3f5-5aa0f54e67d0 req-21491d49-f165-4210-b395-af4bd426b902 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Refreshing instance network info cache due to event network-changed-d785b0df-9954-49ea-b0d7-312a00621a5c. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:55:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b9542744-a03e-49ae-a3f5-5aa0f54e67d0 req-21491d49-f165-4210-b395-af4bd426b902 service nova] Acquiring lock "refresh_cache-a29614f7-abdb-42cb-b40f-9cf3fac0913d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:55:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b9542744-a03e-49ae-a3f5-5aa0f54e67d0 req-21491d49-f165-4210-b395-af4bd426b902 service nova] Acquired lock "refresh_cache-a29614f7-abdb-42cb-b40f-9cf3fac0913d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:55:28 user nova-compute[75000]: DEBUG nova.network.neutron [req-b9542744-a03e-49ae-a3f5-5aa0f54e67d0 req-21491d49-f165-4210-b395-af4bd426b902 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Refreshing network info cache for port d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG nova.network.neutron [req-b9542744-a03e-49ae-a3f5-5aa0f54e67d0 req-21491d49-f165-4210-b395-af4bd426b902 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Updated VIF entry in instance network info cache for port d785b0df-9954-49ea-b0d7-312a00621a5c. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG nova.network.neutron [req-b9542744-a03e-49ae-a3f5-5aa0f54e67d0 req-21491d49-f165-4210-b395-af4bd426b902 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Updating instance_info_cache with network_info: [{"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b9542744-a03e-49ae-a3f5-5aa0f54e67d0 req-21491d49-f165-4210-b395-af4bd426b902 service nova] Releasing lock "refresh_cache-a29614f7-abdb-42cb-b40f-9cf3fac0913d" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:29 user nova-compute[75000]: INFO nova.compute.manager [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Terminating instance
Nov 06 22:55:29 user nova-compute[75000]: DEBUG nova.compute.manager [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Instance destroyed successfully.
Nov 06 22:55:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'resources' on Instance uuid a29614f7-abdb-42cb-b40f-9cf3fac0913d {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:53:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1036587047',display_name='tempest-TestVolumeBootPattern-server-1036587047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1036587047',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D/OAM/5YQAe11VPWv8oDc0xABKrvuAtt9KaN2spjr6XWdYKHlrJcCG8nUWAFETQvI9+ZcAWQjE9tlmsCZUTn3BwjK26nFHLyNit9WqhgP3juOx/+esRcOlreI5rjf3Q==',key_name='tempest-TestVolumeBootPattern-881632780',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:54:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-59euj89v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:54:07Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=a29614f7-abdb-42cb-b40f-9cf3fac0913d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "d785b0df-9954-49ea-b0d7-312a00621a5c", "address": "fa:16:3e:cb:91:85", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd785b0df-99", "ovs_interfaceid": "d785b0df-9954-49ea-b0d7-312a00621a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:91:85,bridge_name='br-int',has_traffic_filtering=True,id=d785b0df-9954-49ea-b0d7-312a00621a5c,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd785b0df-99') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG os_vif [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:91:85,bridge_name='br-int',has_traffic_filtering=True,id=d785b0df-9954-49ea-b0d7-312a00621a5c,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd785b0df-99') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd785b0df-99, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:55:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a953b496-d338-4c8e-904a-98942e547af8) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:30 user nova-compute[75000]: INFO os_vif [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:91:85,bridge_name='br-int',has_traffic_filtering=True,id=d785b0df-9954-49ea-b0d7-312a00621a5c,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd785b0df-99')
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhsKlar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:55:30 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acbe508-5d4c-4ddf-a40a-f15cc1f8a66c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:55:30 user nova-compute[75000]: No targets found.
Nov 06 22:55:30 user nova-compute[75000]: iSNS:
Nov 06 22:55:30 user nova-compute[75000]: No targets found.
Nov 06 22:55:30 user nova-compute[75000]: STATIC:
Nov 06 22:55:30 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8
Nov 06 22:55:30 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:55:30 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:55:30 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa
Nov 06 22:55:30 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:55:30 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:55:30 user nova-compute[75000]: FIRMWARE:
Nov 06 22:55:30 user nova-compute[75000]: No targets found.
Nov 06 22:55:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:55:30 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:55:30 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9171ce-4e6b-4330-b790-5bc9c3535f6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8f103f-3ac8-4454-8a1d-deb8cb8df842]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:55:30 user nova-compute[75000]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:55:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:55:30 user nova-compute[75000]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:55:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b8f000d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa'): ({'sdd'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Removing single pathed devices sdd {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a949f55-f99f-4fc8-8063-0d5f3af5b6cb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cad429-d281-4216-b031-75bf6dcf58dc]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flushing IO for device /dev/sdd {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d1fbe6-055d-4e63-ab6c-b9b360be3664]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5545f5e3-de49-4a9f-ae06-5e9b352abcda]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b43d5-54c2-45b6-89da-8f4c88778c54]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb is timed out.
Nov 06 22:55:30 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Successfully detached device vdb from instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb from the live domain config.
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMZSPIVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:55:30 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8523ab9f-79b5-493f-bdc8-1a7c1361ce66]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260]
Nov 06 22:55:30 user nova-compute[75000]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260] successful.
Nov 06 22:55:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56bb65f-84b1-41f1-b2c0-ef966dac7a10]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== disconnect_volume: return (356ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:55:30 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Deleting instance files /opt/stack/data/nova/instances/a29614f7-abdb-42cb-b40f-9cf3fac0913d_del
Nov 06 22:55:30 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Deletion of /opt/stack/data/nova/instances/a29614f7-abdb-42cb-b40f-9cf3fac0913d_del complete
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.038s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0865c46-a729-495c-9623-609eafc7b5c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:55:30 user nova-compute[75000]: No targets found.
Nov 06 22:55:30 user nova-compute[75000]: iSNS:
Nov 06 22:55:30 user nova-compute[75000]: No targets found.
Nov 06 22:55:30 user nova-compute[75000]: STATIC:
Nov 06 22:55:30 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8
Nov 06 22:55:30 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:55:30 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:55:30 user nova-compute[75000]: FIRMWARE:
Nov 06 22:55:30 user nova-compute[75000]: No targets found.
Nov 06 22:55:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:55:30 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:55:30 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b937c5-857d-459d-a6ac-dac741409bf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: INFO nova.compute.manager [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f874d-be66-40d4-9488-bc7f1791cb25]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:55:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 (non-flash)
Nov 06 22:55:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b8f01a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43865cf-a47b-42c0-b2ce-8bc4ab798817]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0372dab-6540-4232-958b-58065e4dee6b]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eaafd7-184d-48a4-9316-584b7da914e2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eae550-4c5b-4305-9bee-28483adae030]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9d08e6-ec0b-4c7b-a25a-f20393ad40e0]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received event network-vif-unplugged-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] Acquiring lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] No waiting events found dispatching network-vif-unplugged-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received event network-vif-unplugged-d785b0df-9954-49ea-b0d7-312a00621a5c for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received event network-vif-plugged-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] Acquiring lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.compute.manager [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] No waiting events found dispatching network-vif-plugged-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:55:30 user nova-compute[75000]: WARNING nova.compute.manager [req-c0a29a8c-3cdf-4c84-a7e9-6be985df86ac req-0aeed01c-a6fe-4b5d-9b4b-a196bee5ce3e service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received unexpected event network-vif-plugged-d785b0df-9954-49ea-b0d7-312a00621a5c for instance with vm_state active and task_state deleting.
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a09cd4c-eac1-435f-9681-1d08a0a42ab9]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8, portal: 172.16.0.220,3260]
Nov 06 22:55:30 user nova-compute[75000]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8, portal: 172.16.0.220,3260] successful.
Nov 06 22:55:30 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5b1519-f71d-455a-8c49-283a683852c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32d3920-17fe-4926-aa0f-1a6e4f3928f5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] <== disconnect_volume: return (325ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:55:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:55:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:31 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:55:31 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Took 0.80 seconds to deallocate network for instance.
Nov 06 22:55:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-0317755e-fcab-4be6-acf6-429a6a4a3bdc req-f78239b0-4a24-4030-a47a-46c2433891e9 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Received event network-vif-deleted-d785b0df-9954-49ea-b0d7-312a00621a5c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:55:31 user nova-compute[75000]: INFO nova.compute.manager [req-0317755e-fcab-4be6-acf6-429a6a4a3bdc req-f78239b0-4a24-4030-a47a-46c2433891e9 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Neutron deleted interface d785b0df-9954-49ea-b0d7-312a00621a5c; detaching it from the instance and deleting it from the info cache
Nov 06 22:55:31 user nova-compute[75000]: DEBUG nova.network.neutron [req-0317755e-fcab-4be6-acf6-429a6a4a3bdc req-f78239b0-4a24-4030-a47a-46c2433891e9 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:55:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-0317755e-fcab-4be6-acf6-429a6a4a3bdc req-f78239b0-4a24-4030-a47a-46c2433891e9 service nova] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Detach interface failed, port_id=d785b0df-9954-49ea-b0d7-312a00621a5c, reason: Instance a29614f7-abdb-42cb-b40f-9cf3fac0913d could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 22:55:31 user nova-compute[75000]: DEBUG nova.objects.instance [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'flavor' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:55:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-98c8fc9f-efe8-4f29-bcff-3b6ae7cf8c42 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.109s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:32 user nova-compute[75000]: INFO nova.compute.manager [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: a29614f7-abdb-42cb-b40f-9cf3fac0913d] Took 1.01 seconds to detach 1 volumes for instance.
Nov 06 22:55:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:32 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:55:32 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:55:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:32 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Deleted allocations for instance a29614f7-abdb-42cb-b40f-9cf3fac0913d
Nov 06 22:55:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-e8005ac3-b74c-4b4d-bec6-88e0b80da814 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "a29614f7-abdb-42cb-b40f-9cf3fac0913d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.548s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:33 user nova-compute[75000]: INFO nova.compute.manager [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Unshelving
Nov 06 22:55:33 user nova-compute[75000]: INFO nova.virt.block_device [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Booting with volume 15735879-6e23-4f08-9d25-9b36e3e3525b at /dev/vda
Nov 06 22:55:33 user nova-compute[75000]: DEBUG os_brick.utils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a84bc3-37e9-4ab2-b0ee-c55b8d950672]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa5ffff-c3f8-4150-8ca1-c35f0cbb3def]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a3caf3-248a-4b65-a4bf-b5c08ac374a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69012a5f-d73c-4439-8d8e-829cec69eae8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:55:33 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:55:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[58393256-442f-421a-93d5-71f2662dff9a]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG os_brick.utils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:55:33 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating existing volume attachment record: 17f9c4eb-6546-47e3-8e70-25ec465ca79c {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:55:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:55:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:48 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:55:48 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:51 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:55:51 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:55:51 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8721MB free_disk=24.938064575195312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:55:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:55:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:55:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:55:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 22:55:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:55:54 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:55:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:55:56 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:55:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lazy-loading 'pci_requests' on Instance uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:55:57 user nova-compute[75000]: DEBUG nova.objects.instance [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:55:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:55:57 user nova-compute[75000]: INFO nova.compute.claims [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Claim successful on node user
Nov 06 22:55:57 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:55:57 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:55:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:57 user nova-compute[75000]: INFO nova.network.neutron [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquired lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-c76889c7-5e8a-4fd3-82ba-23a5e6d5d740 req-8f4c091c-33a4-41d1-9eaa-27589f1d7bc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-c76889c7-5e8a-4fd3-82ba-23a5e6d5d740 req-8f4c091c-33a4-41d1-9eaa-27589f1d7bc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing instance network info cache due to event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c76889c7-5e8a-4fd3-82ba-23a5e6d5d740 req-8f4c091c-33a4-41d1-9eaa-27589f1d7bc9 service nova] Acquiring lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Releasing lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:55:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Creating image(s)
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Ensure instance console log exists: /opt/stack/data/nova/instances/1f5ad59e-3dfa-40f2-b3bc-27d9b2514495/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Start _get_guest_xml network_info=[{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmapSoxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f5ad59e-3dfa-40f2-b3bc-27d9b2514495', 'attached_at': '', 'detached_at': '', 'volume_id': '15735879-6e23-4f08-9d25-9b36e3e3525b', 'serial': '15735879-6e23-4f08-9d25-9b36e3e3525b'}, 'attachment_id': '17f9c4eb-6546-47e3-8e70-25ec465ca79c', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c76889c7-5e8a-4fd3-82ba-23a5e6d5d740 req-8f4c091c-33a4-41d1-9eaa-27589f1d7bc9 service nova] Acquired lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.network.neutron [req-c76889c7-5e8a-4fd3-82ba-23a5e6d5d740 req-8f4c091c-33a4-41d1-9eaa-27589f1d7bc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:55:58 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:55:58 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.objects.instance [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.objects.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Object Instance<1f5ad59e-3dfa-40f2-b3bc-27d9b2514495> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmapSoxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:55:58 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:55:58 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:55:58 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[122e869c-b82f-4504-a462-a565e7897e97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:55:58 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e146ce55-9e7e-494c-8a65-8474f5049776]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b] added
Nov 06 22:55:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a171854-abfb-48db-8814-38eba936fd42]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb497555-fd35-49dc-b3db-01c0ab7bd548]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmapSoxe {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmapSoxe" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cda061-6af5-4d8b-a5aa-a3907b6e6b0b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jmapSoxe'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e9d669-21ec-43ee-b61b-d485c6b0cc1b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[217c6e5b-b425-4825-b045-1889067e3efc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 22:55:58 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:55:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 22:55:58 user nova-compute[75000]:  {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:55:58 user nova-compute[75000]: WARNING os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 22:55:58 user nova-compute[75000]: 
Nov 06 22:55:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[939494c3-e012-4ebb-b1e2-8d7e8f5ad09d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260]
Nov 06 22:55:59 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260] successful.
Nov 06 22:55:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbe718b-77cf-4d61-b036-00ddbc960269]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1826767-fbe0-4246-a39b-436b9b0c95a7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:55:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:55:59 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[567dc9fb-cd33-4e8a-b869-68dcfd7df4ec]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmapSoxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-c76889c7-5e8a-4fd3-82ba-23a5e6d5d740 req-8f4c091c-33a4-41d1-9eaa-27589f1d7bc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updated VIF entry in instance network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-c76889c7-5e8a-4fd3-82ba-23a5e6d5d740 req-8f4c091c-33a4-41d1-9eaa-27589f1d7bc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:55:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c76889c7-5e8a-4fd3-82ba-23a5e6d5d740 req-8f4c091c-33a4-41d1-9eaa-27589f1d7bc9 service nova] Releasing lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23063313461386133', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063313461386133', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581049709',display_name='tempest-TestShelveInstance-server-1581049709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581049709',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1442804575',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:52:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='67f638f4062f446fadaee2a3bae01e1a',ramdisk_id='',reservation_id='r-t0vw700y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1271715636',owner_user_name='tempest-TestShelveInstance-1271715636-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:55:34Z,user_data=None,user_id='2b32b1bcaeb147338db1e30c98d45cef',uuid=1f5ad59e-3dfa-40f2-b3bc-27d9b2514495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converting VIF {"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.objects.instance [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.objects.base [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Object Instance<1f5ad59e-3dfa-40f2-b3bc-27d9b2514495> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:56:00 user nova-compute[75000]:   <uuid>1f5ad59e-3dfa-40f2-b3bc-27d9b2514495</uuid>
Nov 06 22:56:00 user nova-compute[75000]:   <name>instance-0000002c</name>
Nov 06 22:56:00 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:56:00 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:56:00 user nova-compute[75000]:   <metadata>
Nov 06 22:56:00 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:56:00 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:56:00 user nova-compute[75000]:       <nova:name>tempest-TestShelveInstance-server-1581049709</nova:name>
Nov 06 22:56:00 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:55:58</nova:creationTime>
Nov 06 22:56:00 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:56:00 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:56:00 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:56:00 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:56:00 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:56:00 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:56:00 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:56:00 user nova-compute[75000]:       <nova:owner>
Nov 06 22:56:00 user nova-compute[75000]:         <nova:user uuid="2b32b1bcaeb147338db1e30c98d45cef">tempest-TestShelveInstance-1271715636-project-member</nova:user>
Nov 06 22:56:00 user nova-compute[75000]:         <nova:project uuid="67f638f4062f446fadaee2a3bae01e1a">tempest-TestShelveInstance-1271715636</nova:project>
Nov 06 22:56:00 user nova-compute[75000]:       </nova:owner>
Nov 06 22:56:00 user nova-compute[75000]:       <nova:ports>
Nov 06 22:56:00 user nova-compute[75000]:         <nova:port uuid="1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8">
Nov 06 22:56:00 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 22:56:00 user nova-compute[75000]:         </nova:port>
Nov 06 22:56:00 user nova-compute[75000]:       </nova:ports>
Nov 06 22:56:00 user nova-compute[75000]:     </nova:instance>
Nov 06 22:56:00 user nova-compute[75000]:   </metadata>
Nov 06 22:56:00 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:56:00 user nova-compute[75000]:     <system>
Nov 06 22:56:00 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:56:00 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:56:00 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:56:00 user nova-compute[75000]:       <entry name="serial">1f5ad59e-3dfa-40f2-b3bc-27d9b2514495</entry>
Nov 06 22:56:00 user nova-compute[75000]:       <entry name="uuid">1f5ad59e-3dfa-40f2-b3bc-27d9b2514495</entry>
Nov 06 22:56:00 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:56:00 user nova-compute[75000]:     </system>
Nov 06 22:56:00 user nova-compute[75000]:   </sysinfo>
Nov 06 22:56:00 user nova-compute[75000]:   <os>
Nov 06 22:56:00 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:56:00 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:56:00 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:56:00 user nova-compute[75000]:   </os>
Nov 06 22:56:00 user nova-compute[75000]:   <features>
Nov 06 22:56:00 user nova-compute[75000]:     <acpi/>
Nov 06 22:56:00 user nova-compute[75000]:     <apic/>
Nov 06 22:56:00 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:56:00 user nova-compute[75000]:   </features>
Nov 06 22:56:00 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:56:00 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:56:00 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:56:00 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:56:00 user nova-compute[75000]:   </clock>
Nov 06 22:56:00 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:56:00 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:56:00 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:56:00 user nova-compute[75000]:   </cpu>
Nov 06 22:56:00 user nova-compute[75000]:   <devices>
Nov 06 22:56:00 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:56:00 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:56:00 user nova-compute[75000]:       <source dev="/dev/sdb"/>
Nov 06 22:56:00 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:56:00 user nova-compute[75000]:       <serial>15735879-6e23-4f08-9d25-9b36e3e3525b</serial>
Nov 06 22:56:00 user nova-compute[75000]:     </disk>
Nov 06 22:56:00 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:56:00 user nova-compute[75000]:       <mac address="fa:16:3e:b9:51:12"/>
Nov 06 22:56:00 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:56:00 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:56:00 user nova-compute[75000]:       <target dev="tap1b8ac5f3-39"/>
Nov 06 22:56:00 user nova-compute[75000]:     </interface>
Nov 06 22:56:00 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:56:00 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/1f5ad59e-3dfa-40f2-b3bc-27d9b2514495/console.log" append="off"/>
Nov 06 22:56:00 user nova-compute[75000]:     </serial>
Nov 06 22:56:00 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:56:00 user nova-compute[75000]:     <video>
Nov 06 22:56:00 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:56:00 user nova-compute[75000]:     </video>
Nov 06 22:56:00 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:56:00 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:56:00 user nova-compute[75000]:     </rng>
Nov 06 22:56:00 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:56:00 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:56:00 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:56:00 user nova-compute[75000]:     </memballoon>
Nov 06 22:56:00 user nova-compute[75000]:   </devices>
Nov 06 22:56:00 user nova-compute[75000]: </domain>
Nov 06 22:56:00 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581049709',display_name='tempest-TestShelveInstance-server-1581049709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581049709',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1442804575',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:52:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='67f638f4062f446fadaee2a3bae01e1a',ramdisk_id='',reservation_id='r-t0vw700y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1271715636',owner_user_name='tempest-TestShelveInstance-1271715636-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:55:34Z,user_data=None,user_id='2b32b1bcaeb147338db1e30c98d45cef',uuid=1f5ad59e-3dfa-40f2-b3bc-27d9b2514495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converting VIF {"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG os_vif [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f3efeb9-18e0-5d84-9745-66563726643e', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b8ac5f3-39, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b8ac5f3-39, col_values=(('qos', UUID('3844d0fe-3018-48a6-852c-26b2cf629a56')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b8ac5f3-39, col_values=(('external_ids', {'iface-id': '1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:51:12', 'vm-uuid': '1f5ad59e-3dfa-40f2-b3bc-27d9b2514495'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: INFO os_vif [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39')
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] No VIF found with MAC fa:16:3e:b9:51:12, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:00 user nova-compute[75000]: INFO nova.compute.manager [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Terminating instance
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.compute.manager [req-a39326ad-de81-45b1-8009-dc598c6d6444 req-f94ded0c-11e1-4f95-8d79-545250bdbd09 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-unplugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a39326ad-de81-45b1-8009-dc598c6d6444 req-f94ded0c-11e1-4f95-8d79-545250bdbd09 service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a39326ad-de81-45b1-8009-dc598c6d6444 req-f94ded0c-11e1-4f95-8d79-545250bdbd09 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a39326ad-de81-45b1-8009-dc598c6d6444 req-f94ded0c-11e1-4f95-8d79-545250bdbd09 service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.compute.manager [req-a39326ad-de81-45b1-8009-dc598c6d6444 req-f94ded0c-11e1-4f95-8d79-545250bdbd09 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-unplugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:56:00 user nova-compute[75000]: DEBUG nova.compute.manager [req-a39326ad-de81-45b1-8009-dc598c6d6444 req-f94ded0c-11e1-4f95-8d79-545250bdbd09 service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-unplugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:56:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Instance destroyed successfully.
Nov 06 22:56:01 user nova-compute[75000]: DEBUG nova.objects.instance [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lazy-loading 'resources' on Instance uuid f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1189826598',display_name='tempest-ServerStableDeviceRescueTest-server-1189826598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1189826598',id=41,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORt/xe/qSCDRGFI+7o9IH3tOWYDAW2JZNFvkbb1iGWCHMFgXb10IUNmaEuJ66afGNp1bVppMJMGYR4sJF7amMJ0D3JRACjU8VESaniP/DxVcM9BosmY0u9WRA18TtyuaQ==',key_name='tempest-keypair-805493755',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='532cabdfcc5f44bb89dd80655c501c60',ramdisk_id='',reservation_id='r-lieke9cv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-457048010',owner_user_name='tempest-ServerStableDeviceRescueTest-457048010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40f6f1e5f89e4392ae445be927fd82c0',uuid=f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Converting VIF {"id": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "address": "fa:16:3e:69:c3:d6", "network": {"id": "d9586576-fa73-42e6-8175-f0e8108b087c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1515433445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532cabdfcc5f44bb89dd80655c501c60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc093b13d-e1", "ovs_interfaceid": "c093b13d-e15d-4272-a9a0-23aa4f229e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=c093b13d-e15d-4272-a9a0-23aa4f229e44,network=Network(d9586576-fa73-42e6-8175-f0e8108b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc093b13d-e1') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG os_vif [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=c093b13d-e15d-4272-a9a0-23aa4f229e44,network=Network(d9586576-fa73-42e6-8175-f0e8108b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc093b13d-e1') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc093b13d-e1, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55ab00e2-2b78-4016-b1dd-4dc294a757c5) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:01 user nova-compute[75000]: INFO os_vif [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=c093b13d-e15d-4272-a9a0-23aa4f229e44,network=Network(d9586576-fa73-42e6-8175-f0e8108b087c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc093b13d-e1')
Nov 06 22:56:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Deleting instance files /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb_del
Nov 06 22:56:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Deletion of /opt/stack/data/nova/instances/f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb_del complete
Nov 06 22:56:01 user nova-compute[75000]: INFO nova.compute.manager [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 06 22:56:01 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-5cd5be85-633d-42c9-894b-bd63a916471a req-afdd7658-de50-4575-bfda-be934f13e354 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5cd5be85-633d-42c9-894b-bd63a916471a req-afdd7658-de50-4575-bfda-be934f13e354 service nova] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5cd5be85-633d-42c9-894b-bd63a916471a req-afdd7658-de50-4575-bfda-be934f13e354 service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5cd5be85-633d-42c9-894b-bd63a916471a req-afdd7658-de50-4575-bfda-be934f13e354 service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-5cd5be85-633d-42c9-894b-bd63a916471a req-afdd7658-de50-4575-bfda-be934f13e354 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] No waiting events found dispatching network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:56:02 user nova-compute[75000]: WARNING nova.compute.manager [req-5cd5be85-633d-42c9-894b-bd63a916471a req-afdd7658-de50-4575-bfda-be934f13e354 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received unexpected event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 22:56:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-f87ba72d-87d7-4c7b-8de2-8cfd9724632d req-1e038cf2-5d98-4496-8cb3-20f3e9e57c2e service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f87ba72d-87d7-4c7b-8de2-8cfd9724632d req-1e038cf2-5d98-4496-8cb3-20f3e9e57c2e service nova] Acquiring lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f87ba72d-87d7-4c7b-8de2-8cfd9724632d req-1e038cf2-5d98-4496-8cb3-20f3e9e57c2e service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f87ba72d-87d7-4c7b-8de2-8cfd9724632d req-1e038cf2-5d98-4496-8cb3-20f3e9e57c2e service nova] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-f87ba72d-87d7-4c7b-8de2-8cfd9724632d req-1e038cf2-5d98-4496-8cb3-20f3e9e57c2e service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] No waiting events found dispatching network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:56:02 user nova-compute[75000]: WARNING nova.compute.manager [req-f87ba72d-87d7-4c7b-8de2-8cfd9724632d req-1e038cf2-5d98-4496-8cb3-20f3e9e57c2e service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received unexpected event network-vif-plugged-c093b13d-e15d-4272-a9a0-23aa4f229e44 for instance with vm_state active and task_state deleting.
Nov 06 22:56:03 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:56:03 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Took 1.38 seconds to deallocate network for instance.
Nov 06 22:56:03 user nova-compute[75000]: DEBUG nova.compute.manager [req-73ff3a46-3530-4589-bef7-5d988eceeb8c req-1b4339ee-5076-4bed-81fe-298492e2631e service nova] [instance: f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb] Received event network-vif-deleted-c093b13d-e15d-4272-a9a0-23aa4f229e44 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:56:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:03 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:56:03 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:56:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:03 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Deleted allocations for instance f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb
Nov 06 22:56:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-264a8504-2cd4-4d92-b263-1c687c733877 tempest-ServerStableDeviceRescueTest-457048010 tempest-ServerStableDeviceRescueTest-457048010-project-member] Lock "f2f211c6-224a-4b19-b8b7-c8b5b5ba90eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.158s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:56:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:56:04 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Instance spawned successfully.
Nov 06 22:56:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:56:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-75097326-0318-40b8-b6f5-afa638cea85a tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.576s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e5b8001-efc9-4aeb-bb6e-537cc2b2b0c9 req-0d387483-897f-4aeb-b594-eda4f16c8a0d service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:56:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e5b8001-efc9-4aeb-bb6e-537cc2b2b0c9 req-0d387483-897f-4aeb-b594-eda4f16c8a0d service nova] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e5b8001-efc9-4aeb-bb6e-537cc2b2b0c9 req-0d387483-897f-4aeb-b594-eda4f16c8a0d service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e5b8001-efc9-4aeb-bb6e-537cc2b2b0c9 req-0d387483-897f-4aeb-b594-eda4f16c8a0d service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e5b8001-efc9-4aeb-bb6e-537cc2b2b0c9 req-0d387483-897f-4aeb-b594-eda4f16c8a0d service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] No waiting events found dispatching network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:56:04 user nova-compute[75000]: WARNING nova.compute.manager [req-9e5b8001-efc9-4aeb-bb6e-537cc2b2b0c9 req-0d387483-897f-4aeb-b594-eda4f16c8a0d service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received unexpected event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 for instance with vm_state active and task_state None.
Nov 06 22:56:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:11 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:56:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:56:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:56:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:56:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:56:21 user nova-compute[75000]: INFO nova.compute.claims [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Claim successful on node user
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:56:21 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:56:21 user nova-compute[75000]: INFO nova.virt.block_device [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Booting with volume 0a1d51ea-511b-45a7-97bd-6e335ccbcafa at /dev/vda
Nov 06 22:56:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG os_brick.utils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89c3e24-2b0f-495c-9c7d-754790a372bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.policy [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d4aa96179fd4121ba224f47c01d9364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828fc01bb744496f83bd0f5d90e6924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a202b1a8-0fe9-4470-92f1-2f663acc742d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[584e178d-4527-4fc3-9eed-225dad2f8577]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb73f28a-ea51-4b4c-a80f-246f4c639efa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:56:21 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:56:21 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade9b0ff-79d3-47a8-b999-3b58550bf214]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG os_brick.utils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:56:21 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updating existing volume attachment record: 1e730771-2dd3-488e-b2ee-ed2cd6fbb27e {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:56:22 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Successfully created port: 26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Successfully updated port: 26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquired lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-fd051fab-f496-469c-9d1f-f431ccd5a74c req-3bdac841-31c5-410d-8b9a-0adbf4f9cc8b service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received event network-changed-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.compute.manager [req-fd051fab-f496-469c-9d1f-f431ccd5a74c req-3bdac841-31c5-410d-8b9a-0adbf4f9cc8b service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Refreshing instance network info cache due to event network-changed-26721731-4e40-4e7d-a3ba-cdff28678357. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fd051fab-f496-469c-9d1f-f431ccd5a74c req-3bdac841-31c5-410d-8b9a-0adbf4f9cc8b service nova] Acquiring lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.network.neutron [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updating instance_info_cache with network_info: [{"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Releasing lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Instance network_info: |[{"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fd051fab-f496-469c-9d1f-f431ccd5a74c req-3bdac841-31c5-410d-8b9a-0adbf4f9cc8b service nova] Acquired lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-fd051fab-f496-469c-9d1f-f431ccd5a74c req-3bdac841-31c5-410d-8b9a-0adbf4f9cc8b service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Refreshing network info cache for port 26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-fd051fab-f496-469c-9d1f-f431ccd5a74c req-3bdac841-31c5-410d-8b9a-0adbf4f9cc8b service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updated VIF entry in instance network info cache for port 26721731-4e40-4e7d-a3ba-cdff28678357. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:56:23 user nova-compute[75000]: DEBUG nova.network.neutron [req-fd051fab-f496-469c-9d1f-f431ccd5a74c req-3bdac841-31c5-410d-8b9a-0adbf4f9cc8b service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updating instance_info_cache with network_info: [{"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:56:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fd051fab-f496-469c-9d1f-f431ccd5a74c req-3bdac841-31c5-410d-8b9a-0adbf4f9cc8b service nova] Releasing lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:56:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:56:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:56:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:56:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:56:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:56:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:56:44 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Creating image(s)
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Ensure instance console log exists: /opt/stack/data/nova/instances/ca8bfcc5-303e-450d-8cc3-69319dc4bd6e/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Start _get_guest_xml network_info=[{"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhsKlar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca8bfcc5-303e-450d-8cc3-69319dc4bd6e', 'attached_at': '', 'detached_at': '', 'volume_id': '0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'serial': '0a1d51ea-511b-45a7-97bd-6e335ccbcafa'}, 'attachment_id': '1e730771-2dd3-488e-b2ee-ed2cd6fbb27e', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:56:44 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:56:44 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhsKlar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:56:44 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:56:44 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:56:44 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e655f6b-3370-49d9-89db-9b871072c2aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:56:44 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fa58aa-7029-4f91-bde4-f37ef3257581]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa] added
Nov 06 22:56:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19852f24-f662-416d-afb5-6a6c31f7ab56]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f390e90f-4167-4ebf-9b1b-c80729facb18]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbhsKlar {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbhsKlar" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac155dfe-2980-4aa1-a662-6697d504b09d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MbhsKlar'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e17070d-c9f1-4f29-9885-5ce887d482c3]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea3f83a-a5a6-4534-be10-bf63992fbf03]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:56:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:56:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9878d13f-f707-4b60-a1ef-a9b8d265ff04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260]
Nov 06 22:56:44 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260] successful.
Nov 06 22:56:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac34f84-2985-41ee-9e0d-c6b2e3ad4454]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c6aa9-52a6-404d-abef-4647ad00039a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:56:44 user nova-compute[75000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:56:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:56:44 user nova-compute[75000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:56:44 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[075936ca-6f1f-4c66-8495-0ed7fc94cc94]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:56:44 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhsKlar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26365366132393936', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365366132393936', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-901985789',display_name='tempest-TestVolumeBootPattern-server-901985789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-901985789',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D/OAM/5YQAe11VPWv8oDc0xABKrvuAtt9KaN2spjr6XWdYKHlrJcCG8nUWAFETQvI9+ZcAWQjE9tlmsCZUTn3BwjK26nFHLyNit9WqhgP3juOx/+esRcOlreI5rjf3Q==',key_name='tempest-TestVolumeBootPattern-881632780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-cnxx7uqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:56:22Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=ca8bfcc5-303e-450d-8cc3-69319dc4bd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:8a:2a,bridge_name='br-int',has_traffic_filtering=True,id=26721731-4e40-4e7d-a3ba-cdff28678357,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26721731-4e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG nova.objects.instance [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'pci_devices' on Instance uuid ca8bfcc5-303e-450d-8cc3-69319dc4bd6e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:56:45 user nova-compute[75000]:   <uuid>ca8bfcc5-303e-450d-8cc3-69319dc4bd6e</uuid>
Nov 06 22:56:45 user nova-compute[75000]:   <name>instance-0000002e</name>
Nov 06 22:56:45 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:56:45 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:56:45 user nova-compute[75000]:   <metadata>
Nov 06 22:56:45 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:56:45 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:56:45 user nova-compute[75000]:       <nova:name>tempest-TestVolumeBootPattern-server-901985789</nova:name>
Nov 06 22:56:45 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:56:44</nova:creationTime>
Nov 06 22:56:45 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:56:45 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:56:45 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:56:45 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:56:45 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:56:45 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:56:45 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:56:45 user nova-compute[75000]:       <nova:owner>
Nov 06 22:56:45 user nova-compute[75000]:         <nova:user uuid="0d4aa96179fd4121ba224f47c01d9364">tempest-TestVolumeBootPattern-673062967-project-member</nova:user>
Nov 06 22:56:45 user nova-compute[75000]:         <nova:project uuid="828fc01bb744496f83bd0f5d90e6924f">tempest-TestVolumeBootPattern-673062967</nova:project>
Nov 06 22:56:45 user nova-compute[75000]:       </nova:owner>
Nov 06 22:56:45 user nova-compute[75000]:       <nova:ports>
Nov 06 22:56:45 user nova-compute[75000]:         <nova:port uuid="26721731-4e40-4e7d-a3ba-cdff28678357">
Nov 06 22:56:45 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 22:56:45 user nova-compute[75000]:         </nova:port>
Nov 06 22:56:45 user nova-compute[75000]:       </nova:ports>
Nov 06 22:56:45 user nova-compute[75000]:     </nova:instance>
Nov 06 22:56:45 user nova-compute[75000]:   </metadata>
Nov 06 22:56:45 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:56:45 user nova-compute[75000]:     <system>
Nov 06 22:56:45 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:56:45 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:56:45 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:56:45 user nova-compute[75000]:       <entry name="serial">ca8bfcc5-303e-450d-8cc3-69319dc4bd6e</entry>
Nov 06 22:56:45 user nova-compute[75000]:       <entry name="uuid">ca8bfcc5-303e-450d-8cc3-69319dc4bd6e</entry>
Nov 06 22:56:45 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:56:45 user nova-compute[75000]:     </system>
Nov 06 22:56:45 user nova-compute[75000]:   </sysinfo>
Nov 06 22:56:45 user nova-compute[75000]:   <os>
Nov 06 22:56:45 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:56:45 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:56:45 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:56:45 user nova-compute[75000]:   </os>
Nov 06 22:56:45 user nova-compute[75000]:   <features>
Nov 06 22:56:45 user nova-compute[75000]:     <acpi/>
Nov 06 22:56:45 user nova-compute[75000]:     <apic/>
Nov 06 22:56:45 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:56:45 user nova-compute[75000]:   </features>
Nov 06 22:56:45 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:56:45 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:56:45 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:56:45 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:56:45 user nova-compute[75000]:   </clock>
Nov 06 22:56:45 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:56:45 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:56:45 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:56:45 user nova-compute[75000]:   </cpu>
Nov 06 22:56:45 user nova-compute[75000]:   <devices>
Nov 06 22:56:45 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:56:45 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:56:45 user nova-compute[75000]:       <source dev="/dev/sdc"/>
Nov 06 22:56:45 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:56:45 user nova-compute[75000]:       <serial>0a1d51ea-511b-45a7-97bd-6e335ccbcafa</serial>
Nov 06 22:56:45 user nova-compute[75000]:     </disk>
Nov 06 22:56:45 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:56:45 user nova-compute[75000]:       <mac address="fa:16:3e:1a:8a:2a"/>
Nov 06 22:56:45 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:56:45 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:56:45 user nova-compute[75000]:       <target dev="tap26721731-4e"/>
Nov 06 22:56:45 user nova-compute[75000]:     </interface>
Nov 06 22:56:45 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:56:45 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/ca8bfcc5-303e-450d-8cc3-69319dc4bd6e/console.log" append="off"/>
Nov 06 22:56:45 user nova-compute[75000]:     </serial>
Nov 06 22:56:45 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:56:45 user nova-compute[75000]:     <video>
Nov 06 22:56:45 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:56:45 user nova-compute[75000]:     </video>
Nov 06 22:56:45 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:56:45 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:56:45 user nova-compute[75000]:     </rng>
Nov 06 22:56:45 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:56:45 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:56:45 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:56:45 user nova-compute[75000]:     </memballoon>
Nov 06 22:56:45 user nova-compute[75000]:   </devices>
Nov 06 22:56:45 user nova-compute[75000]: </domain>
Nov 06 22:56:45 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-901985789',display_name='tempest-TestVolumeBootPattern-server-901985789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-901985789',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D/OAM/5YQAe11VPWv8oDc0xABKrvuAtt9KaN2spjr6XWdYKHlrJcCG8nUWAFETQvI9+ZcAWQjE9tlmsCZUTn3BwjK26nFHLyNit9WqhgP3juOx/+esRcOlreI5rjf3Q==',key_name='tempest-TestVolumeBootPattern-881632780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-cnxx7uqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:56:22Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=ca8bfcc5-303e-450d-8cc3-69319dc4bd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:8a:2a,bridge_name='br-int',has_traffic_filtering=True,id=26721731-4e40-4e7d-a3ba-cdff28678357,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26721731-4e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG os_vif [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:8a:2a,bridge_name='br-int',has_traffic_filtering=True,id=26721731-4e40-4e7d-a3ba-cdff28678357,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26721731-4e') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc2eec1c-d24f-57c0-9863-bb41a19d3d85', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26721731-4e, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26721731-4e, col_values=(('qos', UUID('923629af-9add-4417-9937-16b1acd4fc42')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26721731-4e, col_values=(('external_ids', {'iface-id': '26721731-4e40-4e7d-a3ba-cdff28678357', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:8a:2a', 'vm-uuid': 'ca8bfcc5-303e-450d-8cc3-69319dc4bd6e'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:56:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:46 user nova-compute[75000]: INFO os_vif [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:8a:2a,bridge_name='br-int',has_traffic_filtering=True,id=26721731-4e40-4e7d-a3ba-cdff28678357,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26721731-4e')
Nov 06 22:56:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:56:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No VIF found with MAC fa:16:3e:1a:8a:2a, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:56:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e3cdd32-7c18-4f0f-8844-80ee79ae1160 req-2f1f326d-b2ee-4434-89e7-fc88a408f047 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received event network-vif-plugged-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:56:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e3cdd32-7c18-4f0f-8844-80ee79ae1160 req-2f1f326d-b2ee-4434-89e7-fc88a408f047 service nova] Acquiring lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e3cdd32-7c18-4f0f-8844-80ee79ae1160 req-2f1f326d-b2ee-4434-89e7-fc88a408f047 service nova] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9e3cdd32-7c18-4f0f-8844-80ee79ae1160 req-2f1f326d-b2ee-4434-89e7-fc88a408f047 service nova] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-9e3cdd32-7c18-4f0f-8844-80ee79ae1160 req-2f1f326d-b2ee-4434-89e7-fc88a408f047 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] No waiting events found dispatching network-vif-plugged-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:56:47 user nova-compute[75000]: WARNING nova.compute.manager [req-9e3cdd32-7c18-4f0f-8844-80ee79ae1160 req-2f1f326d-b2ee-4434-89e7-fc88a408f047 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received unexpected event network-vif-plugged-26721731-4e40-4e7d-a3ba-cdff28678357 for instance with vm_state building and task_state spawning.
Nov 06 22:56:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:48 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:56:49 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Instance spawned successfully.
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-8e8fc0fb-a381-4c2f-ae94-d1083664bd02 req-a139db80-bcd1-4087-87f2-0cc7989dc531 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received event network-vif-plugged-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8e8fc0fb-a381-4c2f-ae94-d1083664bd02 req-a139db80-bcd1-4087-87f2-0cc7989dc531 service nova] Acquiring lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8e8fc0fb-a381-4c2f-ae94-d1083664bd02 req-a139db80-bcd1-4087-87f2-0cc7989dc531 service nova] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8e8fc0fb-a381-4c2f-ae94-d1083664bd02 req-a139db80-bcd1-4087-87f2-0cc7989dc531 service nova] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-8e8fc0fb-a381-4c2f-ae94-d1083664bd02 req-a139db80-bcd1-4087-87f2-0cc7989dc531 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] No waiting events found dispatching network-vif-plugged-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:56:49 user nova-compute[75000]: WARNING nova.compute.manager [req-8e8fc0fb-a381-4c2f-ae94-d1083664bd02 req-a139db80-bcd1-4087-87f2-0cc7989dc531 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received unexpected event network-vif-plugged-26721731-4e40-4e7d-a3ba-cdff28678357 for instance with vm_state building and task_state spawning.
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:56:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:56:50 user nova-compute[75000]: INFO nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 06 22:56:50 user nova-compute[75000]: DEBUG nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:56:50 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:50 user nova-compute[75000]: INFO nova.compute.manager [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Took 29.03 seconds to build instance.
Nov 06 22:56:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-7637c5d5-8cf7-492f-ace1-43cc6648bb79 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.151s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:52 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:56:53 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:56:53 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8678MB free_disk=25.05108642578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance ca8bfcc5-303e-450d-8cc3-69319dc4bd6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 22:56:53 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 22:56:55 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:55 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:56:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:56:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:59 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:56:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 22:57:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:57:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-bec3af9c-a89d-40bf-b440-7be4ecb51841 req-ca7df76a-6447-45c3-93e9-4c9797cdedc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-bec3af9c-a89d-40bf-b440-7be4ecb51841 req-ca7df76a-6447-45c3-93e9-4c9797cdedc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing instance network info cache due to event network-changed-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bec3af9c-a89d-40bf-b440-7be4ecb51841 req-ca7df76a-6447-45c3-93e9-4c9797cdedc9 service nova] Acquiring lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bec3af9c-a89d-40bf-b440-7be4ecb51841 req-ca7df76a-6447-45c3-93e9-4c9797cdedc9 service nova] Acquired lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG nova.network.neutron [req-bec3af9c-a89d-40bf-b440-7be4ecb51841 req-ca7df76a-6447-45c3-93e9-4c9797cdedc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Refreshing network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.046s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:57:24 user nova-compute[75000]: INFO nova.compute.manager [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Terminating instance
Nov 06 22:57:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.network.neutron [req-bec3af9c-a89d-40bf-b440-7be4ecb51841 req-ca7df76a-6447-45c3-93e9-4c9797cdedc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updated VIF entry in instance network info cache for port 1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.network.neutron [req-bec3af9c-a89d-40bf-b440-7be4ecb51841 req-ca7df76a-6447-45c3-93e9-4c9797cdedc9 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [{"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bec3af9c-a89d-40bf-b440-7be4ecb51841 req-ca7df76a-6447-45c3-93e9-4c9797cdedc9 service nova] Releasing lock "refresh_cache-1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-83cfead7-b04e-464c-8f5a-066f20e6a063 req-06fbb102-16f9-4f68-880b-adb136503dfb service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-unplugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-83cfead7-b04e-464c-8f5a-066f20e6a063 req-06fbb102-16f9-4f68-880b-adb136503dfb service nova] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-83cfead7-b04e-464c-8f5a-066f20e6a063 req-06fbb102-16f9-4f68-880b-adb136503dfb service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-83cfead7-b04e-464c-8f5a-066f20e6a063 req-06fbb102-16f9-4f68-880b-adb136503dfb service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-83cfead7-b04e-464c-8f5a-066f20e6a063 req-06fbb102-16f9-4f68-880b-adb136503dfb service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] No waiting events found dispatching network-vif-unplugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.compute.manager [req-83cfead7-b04e-464c-8f5a-066f20e6a063 req-06fbb102-16f9-4f68-880b-adb136503dfb service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-unplugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 22:57:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Instance destroyed successfully.
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.objects.instance [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lazy-loading 'resources' on Instance uuid 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T22:51:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581049709',display_name='tempest-TestShelveInstance-server-1581049709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581049709',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa+B84ATE/Y1pAOrul2P50e3pxv5IgVKs//Oid+onZBjofnCj7owKSgnbJwFnVEPZG/dGtvVBVDnWfud7yQMSM4afz51CQob0ROvPi1xMY3DFpVCyaJUgcNPpqiBg0dSA==',key_name='tempest-TestShelveInstance-1442804575',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:56:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67f638f4062f446fadaee2a3bae01e1a',ramdisk_id='',reservation_id='r-t0vw700y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1271715636',owner_user_name='tempest-TestShelveInstance-1271715636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:56:04Z,user_data=None,user_id='2b32b1bcaeb147338db1e30c98d45cef',uuid=1f5ad59e-3dfa-40f2-b3bc-27d9b2514495,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converting VIF {"id": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "address": "fa:16:3e:b9:51:12", "network": {"id": "4757c82a-182d-47ec-b761-80ef3f5e6bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1014271086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67f638f4062f446fadaee2a3bae01e1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b8ac5f3-39", "ovs_interfaceid": "1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_vif [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b8ac5f3-39, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3844d0fe-3018-48a6-852c-26b2cf629a56) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:57:25 user nova-compute[75000]: INFO os_vif [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:12,bridge_name='br-int',has_traffic_filtering=True,id=1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8,network=Network(4757c82a-182d-47ec-b761-80ef3f5e6bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b8ac5f3-39')
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmapSoxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:57:25 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca273535-b192-4aa5-a15c-d5efb9cecbc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 22:57:25 user nova-compute[75000]: No targets found.
Nov 06 22:57:25 user nova-compute[75000]: iSNS:
Nov 06 22:57:25 user nova-compute[75000]: No targets found.
Nov 06 22:57:25 user nova-compute[75000]: STATIC:
Nov 06 22:57:25 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b
Nov 06 22:57:25 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:57:25 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:57:25 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa
Nov 06 22:57:25 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 22:57:25 user nova-compute[75000]:                 Iface Name: default
Nov 06 22:57:25 user nova-compute[75000]: FIRMWARE:
Nov 06 22:57:25 user nova-compute[75000]: No targets found.
Nov 06 22:57:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 22:57:25 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 22:57:25 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b660cd-ead6-4bb9-bd49-260c9076fb39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[959bbee5-7c23-4ab2-bfa4-a149f21a8a39]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:57:25 user nova-compute[75000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:57:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b (non-flash)
Nov 06 22:57:25 user nova-compute[75000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:57:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc73c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f507e9-575a-4108-ac3d-c8fc4f89d9b5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2835c965-4e50-4ffb-8b02-98e1358b63c2]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35d537a-113d-430c-9b92-c3a4c3c7b9aa]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f0f900-41db-4fde-90cb-ab6cdf8d5fdd]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d3d224-38a4-463e-8415-079e68274033]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b3e7b5-4200-4c33-9c07-17063555260f]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260]
Nov 06 22:57:25 user nova-compute[75000]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b, portal: 172.16.0.220,3260] successful.
Nov 06 22:57:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15735879-6e23-4f08-9d25-9b36e3e3525b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedef9e0-3df7-47d7-a736-0896cfb44bb6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] <== disconnect_volume: return (319ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 22:57:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Deleting instance files /opt/stack/data/nova/instances/1f5ad59e-3dfa-40f2-b3bc-27d9b2514495_del
Nov 06 22:57:25 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Deletion of /opt/stack/data/nova/instances/1f5ad59e-3dfa-40f2-b3bc-27d9b2514495_del complete
Nov 06 22:57:25 user nova-compute[75000]: INFO nova.compute.manager [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 06 22:57:25 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 22:57:25 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 22:57:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:26 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:57:26 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Took 0.51 seconds to deallocate network for instance.
Nov 06 22:57:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-cb947004-cd7f-4d67-99fc-5c8e5b2d3363 req-218596a3-1d8e-4535-8ace-26df11d28399 service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-deleted-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.compute.manager [req-6fcd4196-e58f-447d-b5e9-5b0a52fd7abe req-46215f71-9c8f-4be2-bbf5-55b4c142bd9c service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6fcd4196-e58f-447d-b5e9-5b0a52fd7abe req-46215f71-9c8f-4be2-bbf5-55b4c142bd9c service nova] Acquiring lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6fcd4196-e58f-447d-b5e9-5b0a52fd7abe req-46215f71-9c8f-4be2-bbf5-55b4c142bd9c service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6fcd4196-e58f-447d-b5e9-5b0a52fd7abe req-46215f71-9c8f-4be2-bbf5-55b4c142bd9c service nova] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.compute.manager [req-6fcd4196-e58f-447d-b5e9-5b0a52fd7abe req-46215f71-9c8f-4be2-bbf5-55b4c142bd9c service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] No waiting events found dispatching network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:57:27 user nova-compute[75000]: WARNING nova.compute.manager [req-6fcd4196-e58f-447d-b5e9-5b0a52fd7abe req-46215f71-9c8f-4be2-bbf5-55b4c142bd9c service nova] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Received unexpected event network-vif-plugged-1b8ac5f3-3991-41e8-9c9b-ff09a32d66a8 for instance with vm_state active and task_state deleting.
Nov 06 22:57:27 user nova-compute[75000]: INFO nova.compute.manager [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Took 0.97 seconds to detach 1 volumes for instance.
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.compute.manager [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] [instance: 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495] Deleting volume: 15735879-6e23-4f08-9d25-9b36e3e3525b {{(pid=75000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:57:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:57:28 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Deleted allocations for instance 1f5ad59e-3dfa-40f2-b3bc-27d9b2514495
Nov 06 22:57:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-2080bf72-7058-41f9-ad9e-fc7588e24655 tempest-TestShelveInstance-1271715636 tempest-TestShelveInstance-1271715636-project-member] Lock "1f5ad59e-3dfa-40f2-b3bc-27d9b2514495" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.493s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:57:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:57:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:57:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:57:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:57:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:57:49 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:57:50 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:57:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:57:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:57:52 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:57:52 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:57:52 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=25.037769317626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance ca8bfcc5-303e-450d-8cc3-69319dc4bd6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:57:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:57:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:57:53 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:57:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:57:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:57:53 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:57:54 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updating instance_info_cache with network_info: [{"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:57:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:57:54 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:57:55 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:57:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:57:56 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:57:59 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:57:59 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:57:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:58:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:58:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:58:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:58:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:58:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:58:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:58:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:11 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:58:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-078a8b97-e9ca-497b-bb1a-8a85eb098be3 req-05f200b4-0be2-475a-b57c-b4f6d19a45ee service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received event network-changed-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:58:13 user nova-compute[75000]: DEBUG nova.compute.manager [req-078a8b97-e9ca-497b-bb1a-8a85eb098be3 req-05f200b4-0be2-475a-b57c-b4f6d19a45ee service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Refreshing instance network info cache due to event network-changed-26721731-4e40-4e7d-a3ba-cdff28678357. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:58:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078a8b97-e9ca-497b-bb1a-8a85eb098be3 req-05f200b4-0be2-475a-b57c-b4f6d19a45ee service nova] Acquiring lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:58:13 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078a8b97-e9ca-497b-bb1a-8a85eb098be3 req-05f200b4-0be2-475a-b57c-b4f6d19a45ee service nova] Acquired lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:58:13 user nova-compute[75000]: DEBUG nova.network.neutron [req-078a8b97-e9ca-497b-bb1a-8a85eb098be3 req-05f200b4-0be2-475a-b57c-b4f6d19a45ee service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Refreshing network info cache for port 26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:58:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-078a8b97-e9ca-497b-bb1a-8a85eb098be3 req-05f200b4-0be2-475a-b57c-b4f6d19a45ee service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updated VIF entry in instance network info cache for port 26721731-4e40-4e7d-a3ba-cdff28678357. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:58:14 user nova-compute[75000]: DEBUG nova.network.neutron [req-078a8b97-e9ca-497b-bb1a-8a85eb098be3 req-05f200b4-0be2-475a-b57c-b4f6d19a45ee service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updating instance_info_cache with network_info: [{"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:58:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-078a8b97-e9ca-497b-bb1a-8a85eb098be3 req-05f200b4-0be2-475a-b57c-b4f6d19a45ee service nova] Releasing lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:58:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "af01beee-7fcb-4c06-b2fe-42475de091c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:35 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:58:36 user nova-compute[75000]: INFO nova.compute.claims [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Claim successful on node user
Nov 06 22:58:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:36 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:58:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:58:36 user nova-compute[75000]: INFO nova.virt.block_device [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Booting with volume 95188d78-c352-45c0-a588-175e02f9bdca at /dev/vda
Nov 06 22:58:36 user nova-compute[75000]: DEBUG os_brick.utils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG nova.policy [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d4aa96179fd4121ba224f47c01d9364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '828fc01bb744496f83bd0f5d90e6924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2ba963-9052-4848-950c-242db385fdf4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de30f54c-d7ff-49c4-b0d1-e5f387d78a45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[587d1f57-bb16-4234-80e0-8241b52b892d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370bef7-cf24-4c53-aaf3-500a9dc1d8c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 22:58:36 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 22:58:36 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d41195a-7669-4e1d-ac58-5fb0417c561e]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG os_brick.utils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:58:36 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Updating existing volume attachment record: 758e3945-6018-46e7-bfec-a76cae7d80c7 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 22:58:38 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Successfully created port: aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:58:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Successfully updated port: aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquired lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-6eaa0067-bdad-4737-8dcf-28ea098b4b01 req-8cdd3317-de5f-43b9-9ec2-7c68fbee352b service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received event network-changed-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-6eaa0067-bdad-4737-8dcf-28ea098b4b01 req-8cdd3317-de5f-43b9-9ec2-7c68fbee352b service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Refreshing instance network info cache due to event network-changed-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6eaa0067-bdad-4737-8dcf-28ea098b4b01 req-8cdd3317-de5f-43b9-9ec2-7c68fbee352b service nova] Acquiring lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Updating instance_info_cache with network_info: [{"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Releasing lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Instance network_info: |[{"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6eaa0067-bdad-4737-8dcf-28ea098b4b01 req-8cdd3317-de5f-43b9-9ec2-7c68fbee352b service nova] Acquired lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.network.neutron [req-6eaa0067-bdad-4737-8dcf-28ea098b4b01 req-8cdd3317-de5f-43b9-9ec2-7c68fbee352b service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Refreshing network info cache for port aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:39 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:58:39 user nova-compute[75000]: INFO nova.compute.claims [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Claim successful on node user
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-6eaa0067-bdad-4737-8dcf-28ea098b4b01 req-8cdd3317-de5f-43b9-9ec2-7c68fbee352b service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Updated VIF entry in instance network info cache for port aab3b01b-4cf1-4cbc-9b27-276a4e6d746e. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-6eaa0067-bdad-4737-8dcf-28ea098b4b01 req-8cdd3317-de5f-43b9-9ec2-7c68fbee352b service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Updating instance_info_cache with network_info: [{"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6eaa0067-bdad-4737-8dcf-28ea098b4b01 req-8cdd3317-de5f-43b9-9ec2-7c68fbee352b service nova] Releasing lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:58:40 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.policy [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0054ae3babc0469ba831d736e05f1dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e14abbdb2a949cca338930641269f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:58:40 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Creating image(s)
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "/opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "/opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "/opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk 1073741824" returned: 0 in 0.125s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:40 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Successfully created port: c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Cannot resize image /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Ensure instance console log exists: /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Successfully updated port: c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquired lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-44af237c-1179-4ff9-8801-6c5a69069b37 req-5ee19aa8-b822-4671-bd00-717754a52f3a service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received event network-changed-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-44af237c-1179-4ff9-8801-6c5a69069b37 req-5ee19aa8-b822-4671-bd00-717754a52f3a service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Refreshing instance network info cache due to event network-changed-c784391a-7528-4146-83d0-c3d432917d2b. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-44af237c-1179-4ff9-8801-6c5a69069b37 req-5ee19aa8-b822-4671-bd00-717754a52f3a service nova] Acquiring lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updating instance_info_cache with network_info: [{"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Releasing lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Instance network_info: |[{"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-44af237c-1179-4ff9-8801-6c5a69069b37 req-5ee19aa8-b822-4671-bd00-717754a52f3a service nova] Acquired lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-44af237c-1179-4ff9-8801-6c5a69069b37 req-5ee19aa8-b822-4671-bd00-717754a52f3a service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Refreshing network info cache for port c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Start _get_guest_xml network_info=[{"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:58:41 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:58:41 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-703245323',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-703245323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7032453',id=48,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU1v+N9Mfg2FL9WurZVa8KiwHZXYd1AWu2YQMlFs8zkUI0l003fcBF2WPstv1+s6GcinsQofY/p/KPmFSZ9h4GsySfK7EuAZJcM3Z8aMRrCKQNCaAwLCTphsPYeiUos5g==',key_name='tempest-keypair-672412354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e14abbdb2a949cca338930641269f13',ramdisk_id='',reservation_id='r-rh1aw71f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1149328702',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:58:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0054ae3babc0469ba831d736e05f1dd1',uuid=b71b11a1-bbcf-4086-8345-737863b9b45b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Converting VIF {"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:66:c8,bridge_name='br-int',has_traffic_filtering=True,id=c784391a-7528-4146-83d0-c3d432917d2b,network=Network(71acf388-9153-4bf5-9b0a-ee91f8e3fc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc784391a-75') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.objects.instance [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lazy-loading 'pci_devices' on Instance uuid b71b11a1-bbcf-4086-8345-737863b9b45b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:58:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:58:41 user nova-compute[75000]:   <uuid>b71b11a1-bbcf-4086-8345-737863b9b45b</uuid>
Nov 06 22:58:41 user nova-compute[75000]:   <name>instance-00000030</name>
Nov 06 22:58:41 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:58:41 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:58:41 user nova-compute[75000]:   <metadata>
Nov 06 22:58:41 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:58:41 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:58:41 user nova-compute[75000]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-703245323</nova:name>
Nov 06 22:58:41 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:58:41</nova:creationTime>
Nov 06 22:58:41 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:58:41 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:58:41 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:58:41 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:58:41 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:58:41 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:58:41 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:58:41 user nova-compute[75000]:       <nova:owner>
Nov 06 22:58:41 user nova-compute[75000]:         <nova:user uuid="0054ae3babc0469ba831d736e05f1dd1">tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member</nova:user>
Nov 06 22:58:41 user nova-compute[75000]:         <nova:project uuid="3e14abbdb2a949cca338930641269f13">tempest-TestServerVolumeAttachScenarioOldVersion-1149328702</nova:project>
Nov 06 22:58:41 user nova-compute[75000]:       </nova:owner>
Nov 06 22:58:41 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:58:41 user nova-compute[75000]:       <nova:ports>
Nov 06 22:58:41 user nova-compute[75000]:         <nova:port uuid="c784391a-7528-4146-83d0-c3d432917d2b">
Nov 06 22:58:41 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 22:58:41 user nova-compute[75000]:         </nova:port>
Nov 06 22:58:41 user nova-compute[75000]:       </nova:ports>
Nov 06 22:58:41 user nova-compute[75000]:     </nova:instance>
Nov 06 22:58:41 user nova-compute[75000]:   </metadata>
Nov 06 22:58:41 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:58:41 user nova-compute[75000]:     <system>
Nov 06 22:58:41 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:58:41 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:58:41 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:58:41 user nova-compute[75000]:       <entry name="serial">b71b11a1-bbcf-4086-8345-737863b9b45b</entry>
Nov 06 22:58:41 user nova-compute[75000]:       <entry name="uuid">b71b11a1-bbcf-4086-8345-737863b9b45b</entry>
Nov 06 22:58:41 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:58:41 user nova-compute[75000]:     </system>
Nov 06 22:58:41 user nova-compute[75000]:   </sysinfo>
Nov 06 22:58:41 user nova-compute[75000]:   <os>
Nov 06 22:58:41 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:58:41 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:58:41 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:58:41 user nova-compute[75000]:   </os>
Nov 06 22:58:41 user nova-compute[75000]:   <features>
Nov 06 22:58:41 user nova-compute[75000]:     <acpi/>
Nov 06 22:58:41 user nova-compute[75000]:     <apic/>
Nov 06 22:58:41 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:58:41 user nova-compute[75000]:   </features>
Nov 06 22:58:41 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:58:41 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:58:41 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:58:41 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:58:41 user nova-compute[75000]:   </clock>
Nov 06 22:58:41 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:58:41 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:58:41 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:58:41 user nova-compute[75000]:   </cpu>
Nov 06 22:58:41 user nova-compute[75000]:   <devices>
Nov 06 22:58:41 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:58:41 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:58:41 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk"/>
Nov 06 22:58:41 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:58:41 user nova-compute[75000]:     </disk>
Nov 06 22:58:41 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:58:41 user nova-compute[75000]:       <mac address="fa:16:3e:37:66:c8"/>
Nov 06 22:58:41 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:58:41 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:58:41 user nova-compute[75000]:       <target dev="tapc784391a-75"/>
Nov 06 22:58:41 user nova-compute[75000]:     </interface>
Nov 06 22:58:41 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:58:41 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/console.log" append="off"/>
Nov 06 22:58:41 user nova-compute[75000]:     </serial>
Nov 06 22:58:41 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:58:41 user nova-compute[75000]:     <video>
Nov 06 22:58:41 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:58:41 user nova-compute[75000]:     </video>
Nov 06 22:58:41 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:58:41 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:58:41 user nova-compute[75000]:     </rng>
Nov 06 22:58:41 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:58:41 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:58:41 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:58:41 user nova-compute[75000]:     </memballoon>
Nov 06 22:58:41 user nova-compute[75000]:   </devices>
Nov 06 22:58:41 user nova-compute[75000]: </domain>
Nov 06 22:58:41 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-703245323',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-703245323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7032453',id=48,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU1v+N9Mfg2FL9WurZVa8KiwHZXYd1AWu2YQMlFs8zkUI0l003fcBF2WPstv1+s6GcinsQofY/p/KPmFSZ9h4GsySfK7EuAZJcM3Z8aMRrCKQNCaAwLCTphsPYeiUos5g==',key_name='tempest-keypair-672412354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e14abbdb2a949cca338930641269f13',ramdisk_id='',reservation_id='r-rh1aw71f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1149328702',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:58:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0054ae3babc0469ba831d736e05f1dd1',uuid=b71b11a1-bbcf-4086-8345-737863b9b45b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Converting VIF {"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:66:c8,bridge_name='br-int',has_traffic_filtering=True,id=c784391a-7528-4146-83d0-c3d432917d2b,network=Network(71acf388-9153-4bf5-9b0a-ee91f8e3fc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc784391a-75') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG os_vif [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:66:c8,bridge_name='br-int',has_traffic_filtering=True,id=c784391a-7528-4146-83d0-c3d432917d2b,network=Network(71acf388-9153-4bf5-9b0a-ee91f8e3fc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc784391a-75') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c315895a-e47d-5834-a490-8b43cb6314a3', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc784391a-75, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc784391a-75, col_values=(('qos', UUID('6dfcecd8-73aa-4cb9-a164-6190e8b5db5f')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc784391a-75, col_values=(('external_ids', {'iface-id': 'c784391a-7528-4146-83d0-c3d432917d2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:66:c8', 'vm-uuid': 'b71b11a1-bbcf-4086-8345-737863b9b45b'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:42 user nova-compute[75000]: INFO os_vif [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:66:c8,bridge_name='br-int',has_traffic_filtering=True,id=c784391a-7528-4146-83d0-c3d432917d2b,network=Network(71acf388-9153-4bf5-9b0a-ee91f8e3fc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc784391a-75')
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] No VIF found with MAC fa:16:3e:37:66:c8, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.network.neutron [req-44af237c-1179-4ff9-8801-6c5a69069b37 req-5ee19aa8-b822-4671-bd00-717754a52f3a service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updated VIF entry in instance network info cache for port c784391a-7528-4146-83d0-c3d432917d2b. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.network.neutron [req-44af237c-1179-4ff9-8801-6c5a69069b37 req-5ee19aa8-b822-4671-bd00-717754a52f3a service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updating instance_info_cache with network_info: [{"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-44af237c-1179-4ff9-8801-6c5a69069b37 req-5ee19aa8-b822-4671-bd00-717754a52f3a service nova] Releasing lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:58:42 user nova-compute[75000]: INFO nova.compute.claims [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Claim successful on node user
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:58:42 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:58:43 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:58:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG nova.policy [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10a609466eee4d45b45ed972ab1e93c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c57cc47f84224a42fb08d00fc8985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:58:43 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Creating image(s)
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "/opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "/opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "/opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.244s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk 1073741824" returned: 0 in 0.066s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "98fd2b05784996bf3ac23b694d24f849e6ea84c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 22:58:43 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-ffadcaf0-c631-46b2-9dc0-fe5b4dab302a req-d7e9dbf9-f963-4400-b5ae-d14e820e774a service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received event network-vif-plugged-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffadcaf0-c631-46b2-9dc0-fe5b4dab302a req-d7e9dbf9-f963-4400-b5ae-d14e820e774a service nova] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffadcaf0-c631-46b2-9dc0-fe5b4dab302a req-d7e9dbf9-f963-4400-b5ae-d14e820e774a service nova] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffadcaf0-c631-46b2-9dc0-fe5b4dab302a req-d7e9dbf9-f963-4400-b5ae-d14e820e774a service nova] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-ffadcaf0-c631-46b2-9dc0-fe5b4dab302a req-d7e9dbf9-f963-4400-b5ae-d14e820e774a service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] No waiting events found dispatching network-vif-plugged-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:58:44 user nova-compute[75000]: WARNING nova.compute.manager [req-ffadcaf0-c631-46b2-9dc0-fe5b4dab302a req-d7e9dbf9-f963-4400-b5ae-d14e820e774a service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received unexpected event network-vif-plugged-c784391a-7528-4146-83d0-c3d432917d2b for instance with vm_state building and task_state spawning.
Nov 06 22:58:44 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Cannot resize image /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Ensure instance console log exists: /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Successfully created port: 81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Successfully updated port: 81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquired lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.network.neutron [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updating instance_info_cache with network_info: [{"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Releasing lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Instance network_info: |[{"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Start _get_guest_xml network_info=[{"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'cf3cd688-ea7b-402f-a42c-d141d8f6e4e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:58:45 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:58:45 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:21:49Z,direct_url=<?>,disk_format='qcow2',id=cf3cd688-ea7b-402f-a42c-d141d8f6e4e9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2c67dd7782834ebda48ea084ff9298ea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:21:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1513436224',display_name='tempest-TestStampPattern-server-1513436224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1513436224',id=49,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzd1TeUb9xHdATOiIf8dKGlOM1ny1WtLBC3p9frwKccZQb58JULy63qIiBmJZtsToMzop1wWDhsDsoTRzfqJCw9ayr51j7hxcgUkCCpFOabwgcVXQ2bATNmgOxvg5Ndug==',key_name='tempest-TestStampPattern-1915820448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78c57cc47f84224a42fb08d00fc8985',ramdisk_id='',reservation_id='r-tl48fyxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1217219102',owner_user_name='tempest-TestStampPattern-1217219102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:58:43Z,user_data=None,user_id='10a609466eee4d45b45ed972ab1e93c1',uuid=c68142ba-96c1-4444-94b2-594540013d5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converting VIF {"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f7:55,bridge_name='br-int',has_traffic_filtering=True,id=81bbdf8f-db63-4132-aec4-b015c5228f86,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bbdf8f-db') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.objects.instance [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'pci_devices' on Instance uuid c68142ba-96c1-4444-94b2-594540013d5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:58:45 user nova-compute[75000]:   <uuid>c68142ba-96c1-4444-94b2-594540013d5f</uuid>
Nov 06 22:58:45 user nova-compute[75000]:   <name>instance-00000031</name>
Nov 06 22:58:45 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:58:45 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:58:45 user nova-compute[75000]:   <metadata>
Nov 06 22:58:45 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:58:45 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:58:45 user nova-compute[75000]:       <nova:name>tempest-TestStampPattern-server-1513436224</nova:name>
Nov 06 22:58:45 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:58:45</nova:creationTime>
Nov 06 22:58:45 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:58:45 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:58:45 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:58:45 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:58:45 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:58:45 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:58:45 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:58:45 user nova-compute[75000]:       <nova:owner>
Nov 06 22:58:45 user nova-compute[75000]:         <nova:user uuid="10a609466eee4d45b45ed972ab1e93c1">tempest-TestStampPattern-1217219102-project-member</nova:user>
Nov 06 22:58:45 user nova-compute[75000]:         <nova:project uuid="a78c57cc47f84224a42fb08d00fc8985">tempest-TestStampPattern-1217219102</nova:project>
Nov 06 22:58:45 user nova-compute[75000]:       </nova:owner>
Nov 06 22:58:45 user nova-compute[75000]:       <nova:root type="image" uuid="cf3cd688-ea7b-402f-a42c-d141d8f6e4e9"/>
Nov 06 22:58:45 user nova-compute[75000]:       <nova:ports>
Nov 06 22:58:45 user nova-compute[75000]:         <nova:port uuid="81bbdf8f-db63-4132-aec4-b015c5228f86">
Nov 06 22:58:45 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 22:58:45 user nova-compute[75000]:         </nova:port>
Nov 06 22:58:45 user nova-compute[75000]:       </nova:ports>
Nov 06 22:58:45 user nova-compute[75000]:     </nova:instance>
Nov 06 22:58:45 user nova-compute[75000]:   </metadata>
Nov 06 22:58:45 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:58:45 user nova-compute[75000]:     <system>
Nov 06 22:58:45 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:58:45 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:58:45 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:58:45 user nova-compute[75000]:       <entry name="serial">c68142ba-96c1-4444-94b2-594540013d5f</entry>
Nov 06 22:58:45 user nova-compute[75000]:       <entry name="uuid">c68142ba-96c1-4444-94b2-594540013d5f</entry>
Nov 06 22:58:45 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:58:45 user nova-compute[75000]:     </system>
Nov 06 22:58:45 user nova-compute[75000]:   </sysinfo>
Nov 06 22:58:45 user nova-compute[75000]:   <os>
Nov 06 22:58:45 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:58:45 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:58:45 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:58:45 user nova-compute[75000]:   </os>
Nov 06 22:58:45 user nova-compute[75000]:   <features>
Nov 06 22:58:45 user nova-compute[75000]:     <acpi/>
Nov 06 22:58:45 user nova-compute[75000]:     <apic/>
Nov 06 22:58:45 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:58:45 user nova-compute[75000]:   </features>
Nov 06 22:58:45 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:58:45 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:58:45 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:58:45 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:58:45 user nova-compute[75000]:   </clock>
Nov 06 22:58:45 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:58:45 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:58:45 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:58:45 user nova-compute[75000]:   </cpu>
Nov 06 22:58:45 user nova-compute[75000]:   <devices>
Nov 06 22:58:45 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 22:58:45 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 22:58:45 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk"/>
Nov 06 22:58:45 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:58:45 user nova-compute[75000]:     </disk>
Nov 06 22:58:45 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:58:45 user nova-compute[75000]:       <mac address="fa:16:3e:82:f7:55"/>
Nov 06 22:58:45 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:58:45 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:58:45 user nova-compute[75000]:       <target dev="tap81bbdf8f-db"/>
Nov 06 22:58:45 user nova-compute[75000]:     </interface>
Nov 06 22:58:45 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:58:45 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/console.log" append="off"/>
Nov 06 22:58:45 user nova-compute[75000]:     </serial>
Nov 06 22:58:45 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:58:45 user nova-compute[75000]:     <video>
Nov 06 22:58:45 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:58:45 user nova-compute[75000]:     </video>
Nov 06 22:58:45 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:58:45 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:58:45 user nova-compute[75000]:     </rng>
Nov 06 22:58:45 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:58:45 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:58:45 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:58:45 user nova-compute[75000]:     </memballoon>
Nov 06 22:58:45 user nova-compute[75000]:   </devices>
Nov 06 22:58:45 user nova-compute[75000]: </domain>
Nov 06 22:58:45 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1513436224',display_name='tempest-TestStampPattern-server-1513436224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1513436224',id=49,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzd1TeUb9xHdATOiIf8dKGlOM1ny1WtLBC3p9frwKccZQb58JULy63qIiBmJZtsToMzop1wWDhsDsoTRzfqJCw9ayr51j7hxcgUkCCpFOabwgcVXQ2bATNmgOxvg5Ndug==',key_name='tempest-TestStampPattern-1915820448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78c57cc47f84224a42fb08d00fc8985',ramdisk_id='',reservation_id='r-tl48fyxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1217219102',owner_user_name='tempest-TestStampPattern-1217219102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:58:43Z,user_data=None,user_id='10a609466eee4d45b45ed972ab1e93c1',uuid=c68142ba-96c1-4444-94b2-594540013d5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converting VIF {"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f7:55,bridge_name='br-int',has_traffic_filtering=True,id=81bbdf8f-db63-4132-aec4-b015c5228f86,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bbdf8f-db') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG os_vif [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f7:55,bridge_name='br-int',has_traffic_filtering=True,id=81bbdf8f-db63-4132-aec4-b015c5228f86,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bbdf8f-db') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ffcb522-7ddd-5fc6-bb8e-d2b1a0dad4a8', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81bbdf8f-db, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81bbdf8f-db, col_values=(('qos', UUID('bc074bd7-4357-4a45-aee3-0b4b8d454d54')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81bbdf8f-db, col_values=(('external_ids', {'iface-id': '81bbdf8f-db63-4132-aec4-b015c5228f86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:f7:55', 'vm-uuid': 'c68142ba-96c1-4444-94b2-594540013d5f'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:45 user nova-compute[75000]: INFO os_vif [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f7:55,bridge_name='br-int',has_traffic_filtering=True,id=81bbdf8f-db63-4132-aec4-b015c5228f86,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bbdf8f-db')
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No VIF found with MAC fa:16:3e:82:f7:55, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:58:45 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Instance spawned successfully.
Nov 06 22:58:45 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:46 user nova-compute[75000]: INFO nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received event network-vif-plugged-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] No waiting events found dispatching network-vif-plugged-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:58:46 user nova-compute[75000]: WARNING nova.compute.manager [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received unexpected event network-vif-plugged-c784391a-7528-4146-83d0-c3d432917d2b for instance with vm_state building and task_state spawning.
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received event network-changed-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.compute.manager [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Refreshing instance network info cache due to event network-changed-81bbdf8f-db63-4132-aec4-b015c5228f86. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] Acquiring lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] Acquired lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.network.neutron [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Refreshing network info cache for port 81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:58:46 user nova-compute[75000]: INFO nova.compute.manager [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Took 6.57 seconds to build instance.
Nov 06 22:58:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dbcb74b7-2d18-42ec-8218-3f415dbab1d2 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.707s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.network.neutron [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updated VIF entry in instance network info cache for port 81bbdf8f-db63-4132-aec4-b015c5228f86. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG nova.network.neutron [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updating instance_info_cache with network_info: [{"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:58:46 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-124a3c70-7134-42b4-8d30-0ca170e1e390 req-bca88ef5-a60e-481b-a694-fc7715f99dd4 service nova] Releasing lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:58:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-93b01735-a675-41c1-99ae-847096402a9c req-2325420a-4dc5-4ac9-ac6c-e309fbca7e2b service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received event network-vif-plugged-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:58:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-93b01735-a675-41c1-99ae-847096402a9c req-2325420a-4dc5-4ac9-ac6c-e309fbca7e2b service nova] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-93b01735-a675-41c1-99ae-847096402a9c req-2325420a-4dc5-4ac9-ac6c-e309fbca7e2b service nova] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:47 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-93b01735-a675-41c1-99ae-847096402a9c req-2325420a-4dc5-4ac9-ac6c-e309fbca7e2b service nova] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:47 user nova-compute[75000]: DEBUG nova.compute.manager [req-93b01735-a675-41c1-99ae-847096402a9c req-2325420a-4dc5-4ac9-ac6c-e309fbca7e2b service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] No waiting events found dispatching network-vif-plugged-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:58:47 user nova-compute[75000]: WARNING nova.compute.manager [req-93b01735-a675-41c1-99ae-847096402a9c req-2325420a-4dc5-4ac9-ac6c-e309fbca7e2b service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received unexpected event network-vif-plugged-81bbdf8f-db63-4132-aec4-b015c5228f86 for instance with vm_state building and task_state spawning.
Nov 06 22:58:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-cf5d9f14-1464-4710-99a5-5e8f9a0d1a3b req-2edc1cb1-8c29-45be-b6c9-ce8f22fa3bad service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received event network-vif-plugged-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cf5d9f14-1464-4710-99a5-5e8f9a0d1a3b req-2edc1cb1-8c29-45be-b6c9-ce8f22fa3bad service nova] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cf5d9f14-1464-4710-99a5-5e8f9a0d1a3b req-2edc1cb1-8c29-45be-b6c9-ce8f22fa3bad service nova] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cf5d9f14-1464-4710-99a5-5e8f9a0d1a3b req-2edc1cb1-8c29-45be-b6c9-ce8f22fa3bad service nova] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.compute.manager [req-cf5d9f14-1464-4710-99a5-5e8f9a0d1a3b req-2edc1cb1-8c29-45be-b6c9-ce8f22fa3bad service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] No waiting events found dispatching network-vif-plugged-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:58:50 user nova-compute[75000]: WARNING nova.compute.manager [req-cf5d9f14-1464-4710-99a5-5e8f9a0d1a3b req-2edc1cb1-8c29-45be-b6c9-ce8f22fa3bad service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received unexpected event network-vif-plugged-81bbdf8f-db63-4132-aec4-b015c5228f86 for instance with vm_state building and task_state spawning.
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:58:50 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Instance spawned successfully.
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:58:50 user nova-compute[75000]: INFO nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Took 7.19 seconds to spawn the instance on the hypervisor.
Nov 06 22:58:50 user nova-compute[75000]: DEBUG nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:58:50 user nova-compute[75000]: INFO nova.compute.manager [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Took 8.01 seconds to build instance.
Nov 06 22:58:50 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-4b5adbde-2422-45e9-a356-7f89a73b160a tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.140s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:51 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:58:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:58:53 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:58:53 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8671MB free_disk=25.022388458251953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance ca8bfcc5-303e-450d-8cc3-69319dc4bd6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance af01beee-7fcb-4c06-b2fe-42475de091c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b71b11a1-bbcf-4086-8345-737863b9b45b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c68142ba-96c1-4444-94b2-594540013d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:58:53 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:58:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:58:55 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:58:55 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:58:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:58:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 22:58:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Skipping network cache update for instance because it is Building. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 22:58:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:58:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:58:56 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:58:56 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid ca8bfcc5-303e-450d-8cc3-69319dc4bd6e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:58:56 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updating instance_info_cache with network_info: [{"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:58:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:58:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:58:57 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:58:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:59:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:59:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:59:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 22:59:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:59:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 22:59:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:59:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:59:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 22:59:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:59:02 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Creating image(s)
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Did not create local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Ensure instance console log exists: /opt/stack/data/nova/instances/af01beee-7fcb-4c06-b2fe-42475de091c0/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Start _get_guest_xml network_info=[{"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyeFnXJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af01beee-7fcb-4c06-b2fe-42475de091c0', 'attached_at': '', 'detached_at': '', 'volume_id': '95188d78-c352-45c0-a588-175e02f9bdca', 'serial': '95188d78-c352-45c0-a588-175e02f9bdca'}, 'attachment_id': '758e3945-6018-46e7-bfec-a76cae7d80c7', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 22:59:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:59:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyeFnXJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 22:59:02 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:59:02 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 22:59:02 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c76457-ecab-4031-bd57-e248048632d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 22:59:02 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1463897a-4a05-4d9d-bad2-c70459e47ccf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca] added
Nov 06 22:59:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a224d2d-cffe-409b-8a38-f1e6b435ff01]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.063s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1691b151-8893-4441-a6d8-5c7fbbb3d176]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UyeFnXJR {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UyeFnXJR" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e929a0d-91ad-41dd-a077-43b61934b870]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UyeFnXJR'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[458cc875-1c55-4e17-8580-cc04c75f9172]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8732750-2da5-4c11-8c24-40f845ed30e3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:59:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:59:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc925082-8af5-4880-9d02-754f0c423762]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca, portal: 172.16.0.220,3260]
Nov 06 22:59:02 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca, portal: 172.16.0.220,3260] successful.
Nov 06 22:59:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[75adcfb4-c4db-4621-8949-b7c65c2e888b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46e1872-2d42-443f-9700-08749cd79e29]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:59:02 user nova-compute[75000]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca (non-flash)
Nov 06 22:59:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 22:59:02 user nova-compute[75000]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca (non-flash)
Nov 06 22:59:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8b699e-5091-4097-a193-f0aed7782a8f]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 22:59:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:59:03 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 22:59:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyeFnXJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 22:59:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 22:59:03 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23833636534646434', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 22:59:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833636534646434', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2051460708',display_name='tempest-TestVolumeBootPattern-server-2051460708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2051460708',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D/OAM/5YQAe11VPWv8oDc0xABKrvuAtt9KaN2spjr6XWdYKHlrJcCG8nUWAFETQvI9+ZcAWQjE9tlmsCZUTn3BwjK26nFHLyNit9WqhgP3juOx/+esRcOlreI5rjf3Q==',key_name='tempest-TestVolumeBootPattern-881632780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-qmk357rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:58:36Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=af01beee-7fcb-4c06-b2fe-42475de091c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=aab3b01b-4cf1-4cbc-9b27-276a4e6d746e,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab3b01b-4c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.objects.instance [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'pci_devices' on Instance uuid af01beee-7fcb-4c06-b2fe-42475de091c0 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] End _get_guest_xml xml=<domain type="kvm">
Nov 06 22:59:04 user nova-compute[75000]:   <uuid>af01beee-7fcb-4c06-b2fe-42475de091c0</uuid>
Nov 06 22:59:04 user nova-compute[75000]:   <name>instance-0000002f</name>
Nov 06 22:59:04 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 22:59:04 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 22:59:04 user nova-compute[75000]:   <metadata>
Nov 06 22:59:04 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 22:59:04 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 22:59:04 user nova-compute[75000]:       <nova:name>tempest-TestVolumeBootPattern-server-2051460708</nova:name>
Nov 06 22:59:04 user nova-compute[75000]:       <nova:creationTime>2023-11-06 22:59:02</nova:creationTime>
Nov 06 22:59:04 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 22:59:04 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 22:59:04 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 22:59:04 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 22:59:04 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 22:59:04 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 22:59:04 user nova-compute[75000]:       </nova:flavor>
Nov 06 22:59:04 user nova-compute[75000]:       <nova:owner>
Nov 06 22:59:04 user nova-compute[75000]:         <nova:user uuid="0d4aa96179fd4121ba224f47c01d9364">tempest-TestVolumeBootPattern-673062967-project-member</nova:user>
Nov 06 22:59:04 user nova-compute[75000]:         <nova:project uuid="828fc01bb744496f83bd0f5d90e6924f">tempest-TestVolumeBootPattern-673062967</nova:project>
Nov 06 22:59:04 user nova-compute[75000]:       </nova:owner>
Nov 06 22:59:04 user nova-compute[75000]:       <nova:ports>
Nov 06 22:59:04 user nova-compute[75000]:         <nova:port uuid="aab3b01b-4cf1-4cbc-9b27-276a4e6d746e">
Nov 06 22:59:04 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 22:59:04 user nova-compute[75000]:         </nova:port>
Nov 06 22:59:04 user nova-compute[75000]:       </nova:ports>
Nov 06 22:59:04 user nova-compute[75000]:     </nova:instance>
Nov 06 22:59:04 user nova-compute[75000]:   </metadata>
Nov 06 22:59:04 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 22:59:04 user nova-compute[75000]:     <system>
Nov 06 22:59:04 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 22:59:04 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 22:59:04 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 22:59:04 user nova-compute[75000]:       <entry name="serial">af01beee-7fcb-4c06-b2fe-42475de091c0</entry>
Nov 06 22:59:04 user nova-compute[75000]:       <entry name="uuid">af01beee-7fcb-4c06-b2fe-42475de091c0</entry>
Nov 06 22:59:04 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 22:59:04 user nova-compute[75000]:     </system>
Nov 06 22:59:04 user nova-compute[75000]:   </sysinfo>
Nov 06 22:59:04 user nova-compute[75000]:   <os>
Nov 06 22:59:04 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 22:59:04 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 22:59:04 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 22:59:04 user nova-compute[75000]:   </os>
Nov 06 22:59:04 user nova-compute[75000]:   <features>
Nov 06 22:59:04 user nova-compute[75000]:     <acpi/>
Nov 06 22:59:04 user nova-compute[75000]:     <apic/>
Nov 06 22:59:04 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 22:59:04 user nova-compute[75000]:   </features>
Nov 06 22:59:04 user nova-compute[75000]:   <clock offset="utc">
Nov 06 22:59:04 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 22:59:04 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 22:59:04 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 22:59:04 user nova-compute[75000]:   </clock>
Nov 06 22:59:04 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 22:59:04 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 22:59:04 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 22:59:04 user nova-compute[75000]:   </cpu>
Nov 06 22:59:04 user nova-compute[75000]:   <devices>
Nov 06 22:59:04 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 22:59:04 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 22:59:04 user nova-compute[75000]:       <source dev="/dev/sdb"/>
Nov 06 22:59:04 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 22:59:04 user nova-compute[75000]:       <serial>95188d78-c352-45c0-a588-175e02f9bdca</serial>
Nov 06 22:59:04 user nova-compute[75000]:     </disk>
Nov 06 22:59:04 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 22:59:04 user nova-compute[75000]:       <mac address="fa:16:3e:6a:d2:59"/>
Nov 06 22:59:04 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:59:04 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 22:59:04 user nova-compute[75000]:       <target dev="tapaab3b01b-4c"/>
Nov 06 22:59:04 user nova-compute[75000]:     </interface>
Nov 06 22:59:04 user nova-compute[75000]:     <serial type="pty">
Nov 06 22:59:04 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/af01beee-7fcb-4c06-b2fe-42475de091c0/console.log" append="off"/>
Nov 06 22:59:04 user nova-compute[75000]:     </serial>
Nov 06 22:59:04 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 22:59:04 user nova-compute[75000]:     <video>
Nov 06 22:59:04 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 22:59:04 user nova-compute[75000]:     </video>
Nov 06 22:59:04 user nova-compute[75000]:     <rng model="virtio">
Nov 06 22:59:04 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 22:59:04 user nova-compute[75000]:     </rng>
Nov 06 22:59:04 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 22:59:04 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 22:59:04 user nova-compute[75000]:       <stats period="10"/>
Nov 06 22:59:04 user nova-compute[75000]:     </memballoon>
Nov 06 22:59:04 user nova-compute[75000]:   </devices>
Nov 06 22:59:04 user nova-compute[75000]: </domain>
Nov 06 22:59:04 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2051460708',display_name='tempest-TestVolumeBootPattern-server-2051460708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2051460708',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D/OAM/5YQAe11VPWv8oDc0xABKrvuAtt9KaN2spjr6XWdYKHlrJcCG8nUWAFETQvI9+ZcAWQjE9tlmsCZUTn3BwjK26nFHLyNit9WqhgP3juOx/+esRcOlreI5rjf3Q==',key_name='tempest-TestVolumeBootPattern-881632780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-qmk357rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:58:36Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=af01beee-7fcb-4c06-b2fe-42475de091c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=aab3b01b-4cf1-4cbc-9b27-276a4e6d746e,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab3b01b-4c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG os_vif [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=aab3b01b-4cf1-4cbc-9b27-276a4e6d746e,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab3b01b-4c') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33028695-c21c-5aa3-a610-a91eba38024c', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaab3b01b-4c, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaab3b01b-4c, col_values=(('qos', UUID('0dd66eb6-7440-4449-920b-a84a3d2520a8')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaab3b01b-4c, col_values=(('external_ids', {'iface-id': 'aab3b01b-4cf1-4cbc-9b27-276a4e6d746e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:d2:59', 'vm-uuid': 'af01beee-7fcb-4c06-b2fe-42475de091c0'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:04 user nova-compute[75000]: INFO os_vif [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=aab3b01b-4cf1-4cbc-9b27-276a4e6d746e,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab3b01b-4c')
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 22:59:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] No VIF found with MAC fa:16:3e:6a:d2:59, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 22:59:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-bcd68327-c2b5-4b7f-8004-1ae50a821b37 req-47e4cba9-d539-4c9c-aea3-1eb675f6e136 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received event network-vif-plugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:59:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bcd68327-c2b5-4b7f-8004-1ae50a821b37 req-47e4cba9-d539-4c9c-aea3-1eb675f6e136 service nova] Acquiring lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bcd68327-c2b5-4b7f-8004-1ae50a821b37 req-47e4cba9-d539-4c9c-aea3-1eb675f6e136 service nova] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-bcd68327-c2b5-4b7f-8004-1ae50a821b37 req-47e4cba9-d539-4c9c-aea3-1eb675f6e136 service nova] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:59:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-bcd68327-c2b5-4b7f-8004-1ae50a821b37 req-47e4cba9-d539-4c9c-aea3-1eb675f6e136 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] No waiting events found dispatching network-vif-plugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:59:05 user nova-compute[75000]: WARNING nova.compute.manager [req-bcd68327-c2b5-4b7f-8004-1ae50a821b37 req-47e4cba9-d539-4c9c-aea3-1eb675f6e136 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received unexpected event network-vif-plugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e for instance with vm_state building and task_state spawning.
Nov 06 22:59:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 22:59:07 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Instance spawned successfully.
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 22:59:07 user nova-compute[75000]: INFO nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-f63c0063-3c52-4685-a47c-63e4a4c612b9 req-903e8843-3b07-44e2-b034-95ceb1044d54 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received event network-vif-plugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f63c0063-3c52-4685-a47c-63e4a4c612b9 req-903e8843-3b07-44e2-b034-95ceb1044d54 service nova] Acquiring lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f63c0063-3c52-4685-a47c-63e4a4c612b9 req-903e8843-3b07-44e2-b034-95ceb1044d54 service nova] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-f63c0063-3c52-4685-a47c-63e4a4c612b9 req-903e8843-3b07-44e2-b034-95ceb1044d54 service nova] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:59:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-f63c0063-3c52-4685-a47c-63e4a4c612b9 req-903e8843-3b07-44e2-b034-95ceb1044d54 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] No waiting events found dispatching network-vif-plugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 22:59:07 user nova-compute[75000]: WARNING nova.compute.manager [req-f63c0063-3c52-4685-a47c-63e4a4c612b9 req-903e8843-3b07-44e2-b034-95ceb1044d54 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received unexpected event network-vif-plugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e for instance with vm_state building and task_state spawning.
Nov 06 22:59:07 user nova-compute[75000]: INFO nova.compute.manager [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Took 31.82 seconds to build instance.
Nov 06 22:59:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9148e039-5581-4cb2-b546-054d2a1bb323 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.939s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:59:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 22:59:55 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:59:55 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8335MB free_disk=24.963462829589844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance ca8bfcc5-303e-450d-8cc3-69319dc4bd6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance af01beee-7fcb-4c06-b2fe-42475de091c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b71b11a1-bbcf-4086-8345-737863b9b45b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c68142ba-96c1-4444-94b2-594540013d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 22:59:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:59:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:56 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:59:56 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:59:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 22:59:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:59:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:59:56 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 22:59:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updating instance_info_cache with network_info: [{"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 22:59:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 22:59:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 22:59:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 22:59:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:57 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 22:59:57 user nova-compute[75000]: INFO nova.compute.claims [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Claim successful on node user
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 22:59:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.policy [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1da9d6a0e8f14304b3d15b89d3d19ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e5d66722e747c98e9b1eb57915287d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 22:59:58 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Creating image(s)
Nov 06 22:59:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "/opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "/opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "73dc6f77a3cf39e17ba774bf60562b48d7987340" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "73dc6f77a3cf39e17ba774bf60562b48d7987340" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Successfully created port: a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG nova.virt.images [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] 6d9a543f-0771-4d1e-8df7-834ea5778fb9 was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340.part /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340.part /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340.converted" returned: 0 in 0.336s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG nova.network.neutron [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Successfully updated port: a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "73dc6f77a3cf39e17ba774bf60562b48d7987340" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.248s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-dc6a4447-deef-4940-90ba-ff84df782098 req-4ac14969-27fa-4dbb-84a4-1dfa35176172 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-dc6a4447-deef-4940-90ba-ff84df782098 req-4ac14969-27fa-4dbb-84a4-1dfa35176172 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing instance network info cache due to event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dc6a4447-deef-4940-90ba-ff84df782098 req-4ac14969-27fa-4dbb-84a4-1dfa35176172 service nova] Acquiring lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dc6a4447-deef-4940-90ba-ff84df782098 req-4ac14969-27fa-4dbb-84a4-1dfa35176172 service nova] Acquired lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-dc6a4447-deef-4940-90ba-ff84df782098 req-4ac14969-27fa-4dbb-84a4-1dfa35176172 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing network info cache for port a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-dc6a4447-deef-4940-90ba-ff84df782098 req-4ac14969-27fa-4dbb-84a4-1dfa35176172 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340 --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "73dc6f77a3cf39e17ba774bf60562b48d7987340" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "73dc6f77a3cf39e17ba774bf60562b48d7987340" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 22:59:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340 --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340,backing_fmt=raw /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340,backing_fmt=raw /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk 1073741824" returned: 0 in 0.064s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "73dc6f77a3cf39e17ba774bf60562b48d7987340" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.network.neutron [req-dc6a4447-deef-4940-90ba-ff84df782098 req-4ac14969-27fa-4dbb-84a4-1dfa35176172 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340 --force-share --output=json" returned: 0 in 0.171s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dc6a4447-deef-4940-90ba-ff84df782098 req-4ac14969-27fa-4dbb-84a4-1dfa35176172 service nova] Releasing lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquired lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.network.neutron [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.network.neutron [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Cannot resize image /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Ensure instance console log exists: /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.network.neutron [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating instance_info_cache with network_info: [{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Releasing lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Instance network_info: |[{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Start _get_guest_xml network_info=[{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:59:55Z,direct_url=<?>,disk_format='qcow2',id=6d9a543f-0771-4d1e-8df7-834ea5778fb9,min_disk=0,min_ram=0,name='tempest-scenario-img--1896139694',owner='87e5d66722e747c98e9b1eb57915287d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:59:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '6d9a543f-0771-4d1e-8df7-834ea5778fb9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 23:00:00 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:00:00 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T22:59:55Z,direct_url=<?>,disk_format='qcow2',id=6d9a543f-0771-4d1e-8df7-834ea5778fb9,min_disk=0,min_ram=0,name='tempest-scenario-img--1896139694',owner='87e5d66722e747c98e9b1eb57915287d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T22:59:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-149096020',display_name='tempest-TestMinimumBasicScenario-server-149096020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-149096020',id=50,image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf8Qv+8D2Gx514+yZ6HpuGxtKZuGQ+2lFjKMN0XpMLqz1WbCbwaE9mBBqm6fCPckDfpijGPupQZaYw1GGnNgZHiEmTXOLz0I5k7ftQfIH79R7DjaX+O29XUxrgz0ny7Aw==',key_name='tempest-TestMinimumBasicScenario-479337453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e5d66722e747c98e9b1eb57915287d',ramdisk_id='',reservation_id='r-24d7l7ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1418906334',owner_user_name='tempest-TestMinimumBasicScenario-1418906334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:59:58Z,user_data=None,user_id='1da9d6a0e8f14304b3d15b89d3d19ebc',uuid=d6d43577-d118-4693-8a6a-92438ac00fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converting VIF {"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.objects.instance [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'pci_devices' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 23:00:00 user nova-compute[75000]:   <uuid>d6d43577-d118-4693-8a6a-92438ac00fc6</uuid>
Nov 06 23:00:00 user nova-compute[75000]:   <name>instance-00000032</name>
Nov 06 23:00:00 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 23:00:00 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 23:00:00 user nova-compute[75000]:   <metadata>
Nov 06 23:00:00 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 23:00:00 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 23:00:00 user nova-compute[75000]:       <nova:name>tempest-TestMinimumBasicScenario-server-149096020</nova:name>
Nov 06 23:00:00 user nova-compute[75000]:       <nova:creationTime>2023-11-06 23:00:00</nova:creationTime>
Nov 06 23:00:00 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 23:00:00 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 23:00:00 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 23:00:00 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 23:00:00 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 23:00:00 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 23:00:00 user nova-compute[75000]:       </nova:flavor>
Nov 06 23:00:00 user nova-compute[75000]:       <nova:owner>
Nov 06 23:00:00 user nova-compute[75000]:         <nova:user uuid="1da9d6a0e8f14304b3d15b89d3d19ebc">tempest-TestMinimumBasicScenario-1418906334-project-member</nova:user>
Nov 06 23:00:00 user nova-compute[75000]:         <nova:project uuid="87e5d66722e747c98e9b1eb57915287d">tempest-TestMinimumBasicScenario-1418906334</nova:project>
Nov 06 23:00:00 user nova-compute[75000]:       </nova:owner>
Nov 06 23:00:00 user nova-compute[75000]:       <nova:root type="image" uuid="6d9a543f-0771-4d1e-8df7-834ea5778fb9"/>
Nov 06 23:00:00 user nova-compute[75000]:       <nova:ports>
Nov 06 23:00:00 user nova-compute[75000]:         <nova:port uuid="a7d95d6d-f5c0-43c1-8be1-bbe2798779ca">
Nov 06 23:00:00 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 23:00:00 user nova-compute[75000]:         </nova:port>
Nov 06 23:00:00 user nova-compute[75000]:       </nova:ports>
Nov 06 23:00:00 user nova-compute[75000]:     </nova:instance>
Nov 06 23:00:00 user nova-compute[75000]:   </metadata>
Nov 06 23:00:00 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 23:00:00 user nova-compute[75000]:     <system>
Nov 06 23:00:00 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 23:00:00 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 23:00:00 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 23:00:00 user nova-compute[75000]:       <entry name="serial">d6d43577-d118-4693-8a6a-92438ac00fc6</entry>
Nov 06 23:00:00 user nova-compute[75000]:       <entry name="uuid">d6d43577-d118-4693-8a6a-92438ac00fc6</entry>
Nov 06 23:00:00 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 23:00:00 user nova-compute[75000]:     </system>
Nov 06 23:00:00 user nova-compute[75000]:   </sysinfo>
Nov 06 23:00:00 user nova-compute[75000]:   <os>
Nov 06 23:00:00 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 23:00:00 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 23:00:00 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 23:00:00 user nova-compute[75000]:   </os>
Nov 06 23:00:00 user nova-compute[75000]:   <features>
Nov 06 23:00:00 user nova-compute[75000]:     <acpi/>
Nov 06 23:00:00 user nova-compute[75000]:     <apic/>
Nov 06 23:00:00 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 23:00:00 user nova-compute[75000]:   </features>
Nov 06 23:00:00 user nova-compute[75000]:   <clock offset="utc">
Nov 06 23:00:00 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 23:00:00 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 23:00:00 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 23:00:00 user nova-compute[75000]:   </clock>
Nov 06 23:00:00 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 23:00:00 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 23:00:00 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 23:00:00 user nova-compute[75000]:   </cpu>
Nov 06 23:00:00 user nova-compute[75000]:   <devices>
Nov 06 23:00:00 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 23:00:00 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 23:00:00 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk"/>
Nov 06 23:00:00 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 23:00:00 user nova-compute[75000]:     </disk>
Nov 06 23:00:00 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 23:00:00 user nova-compute[75000]:       <mac address="fa:16:3e:c1:ad:45"/>
Nov 06 23:00:00 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 23:00:00 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 23:00:00 user nova-compute[75000]:       <target dev="tapa7d95d6d-f5"/>
Nov 06 23:00:00 user nova-compute[75000]:     </interface>
Nov 06 23:00:00 user nova-compute[75000]:     <serial type="pty">
Nov 06 23:00:00 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/console.log" append="off"/>
Nov 06 23:00:00 user nova-compute[75000]:     </serial>
Nov 06 23:00:00 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 23:00:00 user nova-compute[75000]:     <video>
Nov 06 23:00:00 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 23:00:00 user nova-compute[75000]:     </video>
Nov 06 23:00:00 user nova-compute[75000]:     <rng model="virtio">
Nov 06 23:00:00 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 23:00:00 user nova-compute[75000]:     </rng>
Nov 06 23:00:00 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 23:00:00 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 23:00:00 user nova-compute[75000]:       <stats period="10"/>
Nov 06 23:00:00 user nova-compute[75000]:     </memballoon>
Nov 06 23:00:00 user nova-compute[75000]:   </devices>
Nov 06 23:00:00 user nova-compute[75000]: </domain>
Nov 06 23:00:00 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-149096020',display_name='tempest-TestMinimumBasicScenario-server-149096020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-149096020',id=50,image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf8Qv+8D2Gx514+yZ6HpuGxtKZuGQ+2lFjKMN0XpMLqz1WbCbwaE9mBBqm6fCPckDfpijGPupQZaYw1GGnNgZHiEmTXOLz0I5k7ftQfIH79R7DjaX+O29XUxrgz0ny7Aw==',key_name='tempest-TestMinimumBasicScenario-479337453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e5d66722e747c98e9b1eb57915287d',ramdisk_id='',reservation_id='r-24d7l7ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1418906334',owner_user_name='tempest-TestMinimumBasicScenario-1418906334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T22:59:58Z,user_data=None,user_id='1da9d6a0e8f14304b3d15b89d3d19ebc',uuid=d6d43577-d118-4693-8a6a-92438ac00fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converting VIF {"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG os_vif [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '147ed6dc-28a8-5937-8c93-3f8b5efed9bd', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7d95d6d-f5, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7d95d6d-f5, col_values=(('qos', UUID('e963e1b4-f814-44b1-bc65-278003dcc242')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7d95d6d-f5, col_values=(('external_ids', {'iface-id': 'a7d95d6d-f5c0-43c1-8be1-bbe2798779ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:ad:45', 'vm-uuid': 'd6d43577-d118-4693-8a6a-92438ac00fc6'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:00 user nova-compute[75000]: INFO os_vif [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5')
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:00:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No VIF found with MAC fa:16:3e:c1:ad:45, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 23:00:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:00:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:00:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-ced931f2-6573-4076-a7be-28acf7253d87 req-f8b3ddb9-8373-4653-82fe-439b27c4d8fc service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ced931f2-6573-4076-a7be-28acf7253d87 req-f8b3ddb9-8373-4653-82fe-439b27c4d8fc service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ced931f2-6573-4076-a7be-28acf7253d87 req-f8b3ddb9-8373-4653-82fe-439b27c4d8fc service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ced931f2-6573-4076-a7be-28acf7253d87 req-f8b3ddb9-8373-4653-82fe-439b27c4d8fc service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-ced931f2-6573-4076-a7be-28acf7253d87 req-f8b3ddb9-8373-4653-82fe-439b27c4d8fc service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:00:02 user nova-compute[75000]: WARNING nova.compute.manager [req-ced931f2-6573-4076-a7be-28acf7253d87 req-f8b3ddb9-8373-4653-82fe-439b27c4d8fc service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state building and task_state spawning.
Nov 06 23:00:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 23:00:04 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Instance spawned successfully.
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:00:04 user nova-compute[75000]: INFO nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 23:00:04 user nova-compute[75000]: INFO nova.compute.manager [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Took 6.63 seconds to build instance.
Nov 06 23:00:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-30766340-bc2c-4d37-9fb8-2dd055c4397b tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.761s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-7d9a925e-cbab-4826-8aa6-c46729c7bd24 req-b1b2b946-354f-4969-af3c-56396f532d4f service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7d9a925e-cbab-4826-8aa6-c46729c7bd24 req-b1b2b946-354f-4969-af3c-56396f532d4f service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7d9a925e-cbab-4826-8aa6-c46729c7bd24 req-b1b2b946-354f-4969-af3c-56396f532d4f service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-7d9a925e-cbab-4826-8aa6-c46729c7bd24 req-b1b2b946-354f-4969-af3c-56396f532d4f service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:04 user nova-compute[75000]: DEBUG nova.compute.manager [req-7d9a925e-cbab-4826-8aa6-c46729c7bd24 req-b1b2b946-354f-4969-af3c-56396f532d4f service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:00:04 user nova-compute[75000]: WARNING nova.compute.manager [req-7d9a925e-cbab-4826-8aa6-c46729c7bd24 req-b1b2b946-354f-4969-af3c-56396f532d4f service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state active and task_state None.
Nov 06 23:00:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:14 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:00:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:27 user nova-compute[75000]: DEBUG nova.compute.manager [req-d98da7ff-39de-4c06-bcfb-7d7b0c8fe8a8 req-d36fd72f-3950-462e-a4b1-85ccbad0365e service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received event network-changed-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:00:27 user nova-compute[75000]: DEBUG nova.compute.manager [req-d98da7ff-39de-4c06-bcfb-7d7b0c8fe8a8 req-d36fd72f-3950-462e-a4b1-85ccbad0365e service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Refreshing instance network info cache due to event network-changed-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:00:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d98da7ff-39de-4c06-bcfb-7d7b0c8fe8a8 req-d36fd72f-3950-462e-a4b1-85ccbad0365e service nova] Acquiring lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:00:27 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d98da7ff-39de-4c06-bcfb-7d7b0c8fe8a8 req-d36fd72f-3950-462e-a4b1-85ccbad0365e service nova] Acquired lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:00:27 user nova-compute[75000]: DEBUG nova.network.neutron [req-d98da7ff-39de-4c06-bcfb-7d7b0c8fe8a8 req-d36fd72f-3950-462e-a4b1-85ccbad0365e service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Refreshing network info cache for port aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG nova.network.neutron [req-d98da7ff-39de-4c06-bcfb-7d7b0c8fe8a8 req-d36fd72f-3950-462e-a4b1-85ccbad0365e service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Updated VIF entry in instance network info cache for port aab3b01b-4cf1-4cbc-9b27-276a4e6d746e. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG nova.network.neutron [req-d98da7ff-39de-4c06-bcfb-7d7b0c8fe8a8 req-d36fd72f-3950-462e-a4b1-85ccbad0365e service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Updating instance_info_cache with network_info: [{"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d98da7ff-39de-4c06-bcfb-7d7b0c8fe8a8 req-d36fd72f-3950-462e-a4b1-85ccbad0365e service nova] Releasing lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "af01beee-7fcb-4c06-b2fe-42475de091c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:28 user nova-compute[75000]: INFO nova.compute.manager [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Terminating instance
Nov 06 23:00:28 user nova-compute[75000]: DEBUG nova.compute.manager [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-d71ae513-58c5-4124-a89b-4153337a12fb req-d5d4bd00-5c7c-4fae-a925-848c7bd49da9 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received event network-vif-unplugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d71ae513-58c5-4124-a89b-4153337a12fb req-d5d4bd00-5c7c-4fae-a925-848c7bd49da9 service nova] Acquiring lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d71ae513-58c5-4124-a89b-4153337a12fb req-d5d4bd00-5c7c-4fae-a925-848c7bd49da9 service nova] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-d71ae513-58c5-4124-a89b-4153337a12fb req-d5d4bd00-5c7c-4fae-a925-848c7bd49da9 service nova] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-d71ae513-58c5-4124-a89b-4153337a12fb req-d5d4bd00-5c7c-4fae-a925-848c7bd49da9 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] No waiting events found dispatching network-vif-unplugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:00:28 user nova-compute[75000]: DEBUG nova.compute.manager [req-d71ae513-58c5-4124-a89b-4153337a12fb req-d5d4bd00-5c7c-4fae-a925-848c7bd49da9 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received event network-vif-unplugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Instance destroyed successfully.
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.objects.instance [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'resources' on Instance uuid af01beee-7fcb-4c06-b2fe-42475de091c0 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2051460708',display_name='tempest-TestVolumeBootPattern-server-2051460708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2051460708',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D/OAM/5YQAe11VPWv8oDc0xABKrvuAtt9KaN2spjr6XWdYKHlrJcCG8nUWAFETQvI9+ZcAWQjE9tlmsCZUTn3BwjK26nFHLyNit9WqhgP3juOx/+esRcOlreI5rjf3Q==',key_name='tempest-TestVolumeBootPattern-881632780',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:59:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-qmk357rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:59:08Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=af01beee-7fcb-4c06-b2fe-42475de091c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=aab3b01b-4cf1-4cbc-9b27-276a4e6d746e,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab3b01b-4c') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_vif [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=aab3b01b-4cf1-4cbc-9b27-276a4e6d746e,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab3b01b-4c') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaab3b01b-4c, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dd66eb6-7440-4449-920b-a84a3d2520a8) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:00:29 user nova-compute[75000]: INFO os_vif [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=aab3b01b-4cf1-4cbc-9b27-276a4e6d746e,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaab3b01b-4c')
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UyeFnXJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:00:29 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[134d947b-ade4-4da8-8b73-8c9211ce55bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 23:00:29 user nova-compute[75000]: No targets found.
Nov 06 23:00:29 user nova-compute[75000]: iSNS:
Nov 06 23:00:29 user nova-compute[75000]: No targets found.
Nov 06 23:00:29 user nova-compute[75000]: STATIC:
Nov 06 23:00:29 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca
Nov 06 23:00:29 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:00:29 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:00:29 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa
Nov 06 23:00:29 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:00:29 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:00:29 user nova-compute[75000]: FIRMWARE:
Nov 06 23:00:29 user nova-compute[75000]: No targets found.
Nov 06 23:00:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 23:00:29 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 23:00:29 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e26be-2075-470b-b9ba-79646f7d5572]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c8a958-b155-4929-b8d0-207a4bc63284]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:00:29 user nova-compute[75000]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca (non-flash)
Nov 06 23:00:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:00:29 user nova-compute[75000]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca (non-flash)
Nov 06 23:00:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b8f92dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bb3c64-e044-4363-a3b2-49d66a5794ed]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b0fae-d009-4cd3-b379-a8302779df05]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3180cd2-9629-4920-bae9-6b988d816225]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5952ce78-caad-4bf3-94db-d56cdf61a3a4]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO77e454c6-83ce4dd438d870dd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_77e454c6', '/dev/disk/by-id/scsi-23833636534646434') {{(pid=86571) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ed1ec-2db7-492c-a4c0-c7b6c88acf23]: (4, None) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-e8e4a8f5-f391-4a52-a766-b6a053f12323 req-14592ecb-a668-4ac2-9db8-163037fce0e0 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received event network-changed-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.compute.manager [req-e8e4a8f5-f391-4a52-a766-b6a053f12323 req-14592ecb-a668-4ac2-9db8-163037fce0e0 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Refreshing instance network info cache due to event network-changed-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8e4a8f5-f391-4a52-a766-b6a053f12323 req-14592ecb-a668-4ac2-9db8-163037fce0e0 service nova] Acquiring lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8e4a8f5-f391-4a52-a766-b6a053f12323 req-14592ecb-a668-4ac2-9db8-163037fce0e0 service nova] Acquired lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.network.neutron [req-e8e4a8f5-f391-4a52-a766-b6a053f12323 req-14592ecb-a668-4ac2-9db8-163037fce0e0 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Refreshing network info cache for port aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a257be-4843-491f-86c2-da12a39cccd8]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ef9b4-fb29-4726-b855-3f9ff959cec3]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca, portal: 172.16.0.220,3260]
Nov 06 23:00:29 user nova-compute[75000]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca, portal: 172.16.0.220,3260] successful.
Nov 06 23:00:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95188d78-c352-45c0-a588-175e02f9bdca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[76610df7-1c4f-4744-8500-a9c41c49bf28]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== disconnect_volume: return (352ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 23:00:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Deleting instance files /opt/stack/data/nova/instances/af01beee-7fcb-4c06-b2fe-42475de091c0_del
Nov 06 23:00:29 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Deletion of /opt/stack/data/nova/instances/af01beee-7fcb-4c06-b2fe-42475de091c0_del complete
Nov 06 23:00:29 user nova-compute[75000]: INFO nova.compute.manager [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 06 23:00:29 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 23:00:29 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 23:00:30 user nova-compute[75000]: DEBUG nova.network.neutron [req-e8e4a8f5-f391-4a52-a766-b6a053f12323 req-14592ecb-a668-4ac2-9db8-163037fce0e0 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Updated VIF entry in instance network info cache for port aab3b01b-4cf1-4cbc-9b27-276a4e6d746e. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:00:30 user nova-compute[75000]: DEBUG nova.network.neutron [req-e8e4a8f5-f391-4a52-a766-b6a053f12323 req-14592ecb-a668-4ac2-9db8-163037fce0e0 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Updating instance_info_cache with network_info: [{"id": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "address": "fa:16:3e:6a:d2:59", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaab3b01b-4c", "ovs_interfaceid": "aab3b01b-4cf1-4cbc-9b27-276a4e6d746e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:00:30 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-e8e4a8f5-f391-4a52-a766-b6a053f12323 req-14592ecb-a668-4ac2-9db8-163037fce0e0 service nova] Releasing lock "refresh_cache-af01beee-7fcb-4c06-b2fe-42475de091c0" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:00:31 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:00:31 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Took 1.09 seconds to deallocate network for instance.
Nov 06 23:00:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-a5a001b4-c939-4c54-88af-82f1f99cf396 req-065cf861-9ab3-4f38-be82-5c12fe98c9e3 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received event network-vif-plugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:00:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a5a001b4-c939-4c54-88af-82f1f99cf396 req-065cf861-9ab3-4f38-be82-5c12fe98c9e3 service nova] Acquiring lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a5a001b4-c939-4c54-88af-82f1f99cf396 req-065cf861-9ab3-4f38-be82-5c12fe98c9e3 service nova] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a5a001b4-c939-4c54-88af-82f1f99cf396 req-065cf861-9ab3-4f38-be82-5c12fe98c9e3 service nova] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-a5a001b4-c939-4c54-88af-82f1f99cf396 req-065cf861-9ab3-4f38-be82-5c12fe98c9e3 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] No waiting events found dispatching network-vif-plugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:00:31 user nova-compute[75000]: WARNING nova.compute.manager [req-a5a001b4-c939-4c54-88af-82f1f99cf396 req-065cf861-9ab3-4f38-be82-5c12fe98c9e3 service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received unexpected event network-vif-plugged-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e for instance with vm_state active and task_state deleting.
Nov 06 23:00:31 user nova-compute[75000]: DEBUG nova.compute.manager [req-16472ba5-37ae-4e26-988a-d8df32961445 req-059bc58e-6efb-42f8-b339-9327375b798f service nova] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Received event network-vif-deleted-aab3b01b-4cf1-4cbc-9b27-276a4e6d746e {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:00:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:31 user nova-compute[75000]: INFO nova.compute.manager [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: af01beee-7fcb-4c06-b2fe-42475de091c0] Took 0.89 seconds to detach 1 volumes for instance.
Nov 06 23:00:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:32 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:00:32 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:00:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:32 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Deleted allocations for instance af01beee-7fcb-4c06-b2fe-42475de091c0
Nov 06 23:00:32 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-d93b61ed-583d-44b6-ae98-454aa2485a5b tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "af01beee-7fcb-4c06-b2fe-42475de091c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.693s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:33 user nova-compute[75000]: DEBUG nova.compute.manager [req-3bd86829-7268-4f0f-84b5-fdee86c4a394 req-b17b1949-d216-4c42-9c3a-ed4cb2b4816e service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received event network-changed-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:00:33 user nova-compute[75000]: DEBUG nova.compute.manager [req-3bd86829-7268-4f0f-84b5-fdee86c4a394 req-b17b1949-d216-4c42-9c3a-ed4cb2b4816e service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Refreshing instance network info cache due to event network-changed-c784391a-7528-4146-83d0-c3d432917d2b. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:00:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3bd86829-7268-4f0f-84b5-fdee86c4a394 req-b17b1949-d216-4c42-9c3a-ed4cb2b4816e service nova] Acquiring lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:00:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3bd86829-7268-4f0f-84b5-fdee86c4a394 req-b17b1949-d216-4c42-9c3a-ed4cb2b4816e service nova] Acquired lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:00:33 user nova-compute[75000]: DEBUG nova.network.neutron [req-3bd86829-7268-4f0f-84b5-fdee86c4a394 req-b17b1949-d216-4c42-9c3a-ed4cb2b4816e service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Refreshing network info cache for port c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:00:33 user nova-compute[75000]: DEBUG nova.network.neutron [req-3bd86829-7268-4f0f-84b5-fdee86c4a394 req-b17b1949-d216-4c42-9c3a-ed4cb2b4816e service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updated VIF entry in instance network info cache for port c784391a-7528-4146-83d0-c3d432917d2b. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:00:33 user nova-compute[75000]: DEBUG nova.network.neutron [req-3bd86829-7268-4f0f-84b5-fdee86c4a394 req-b17b1949-d216-4c42-9c3a-ed4cb2b4816e service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updating instance_info_cache with network_info: [{"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:00:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3bd86829-7268-4f0f-84b5-fdee86c4a394 req-b17b1949-d216-4c42-9c3a-ed4cb2b4816e service nova] Releasing lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:00:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-6387827a-4a35-489d-914e-5e95d6ad1308 req-9e1f6f9c-e3e0-404f-9098-a4ab9e5dfb37 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received event network-changed-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-6387827a-4a35-489d-914e-5e95d6ad1308 req-9e1f6f9c-e3e0-404f-9098-a4ab9e5dfb37 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Refreshing instance network info cache due to event network-changed-81bbdf8f-db63-4132-aec4-b015c5228f86. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6387827a-4a35-489d-914e-5e95d6ad1308 req-9e1f6f9c-e3e0-404f-9098-a4ab9e5dfb37 service nova] Acquiring lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6387827a-4a35-489d-914e-5e95d6ad1308 req-9e1f6f9c-e3e0-404f-9098-a4ab9e5dfb37 service nova] Acquired lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG nova.network.neutron [req-6387827a-4a35-489d-914e-5e95d6ad1308 req-9e1f6f9c-e3e0-404f-9098-a4ab9e5dfb37 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Refreshing network info cache for port 81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'flavor' on Instance uuid c68142ba-96c1-4444-94b2-594540013d5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:35 user nova-compute[75000]: INFO nova.compute.manager [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Attaching volume 68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 to /dev/vdb
Nov 06 23:00:35 user nova-compute[75000]: DEBUG os_brick.utils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG nova.network.neutron [req-6387827a-4a35-489d-914e-5e95d6ad1308 req-9e1f6f9c-e3e0-404f-9098-a4ab9e5dfb37 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updated VIF entry in instance network info cache for port 81bbdf8f-db63-4132-aec4-b015c5228f86. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG nova.network.neutron [req-6387827a-4a35-489d-914e-5e95d6ad1308 req-9e1f6f9c-e3e0-404f-9098-a4ab9e5dfb37 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updating instance_info_cache with network_info: [{"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd392a5e-f5ab-43c5-a0ef-c3ce64c58afe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6387827a-4a35-489d-914e-5e95d6ad1308 req-9e1f6f9c-e3e0-404f-9098-a4ab9e5dfb37 service nova] Releasing lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2474cc63-2c59-423e-81fc-251059ba44df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8d15af-78d7-4f6e-b2a0-f78ad702e5a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7976e995-4796-4993-8c99-c88ba1952506]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:00:35 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 23:00:35 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b59ee6-864f-4d4a-9d75-ce8413043207]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG os_brick.utils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:00:35 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updating existing volume attachment record: fdca4d75-5c1a-4b88-965d-4e33a6935dcc {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 23:00:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG nova.objects.instance [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lazy-loading 'flavor' on Instance uuid b71b11a1-bbcf-4086-8345-737863b9b45b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:37 user nova-compute[75000]: INFO nova.compute.manager [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Attaching volume 78e9b438-1190-48c8-b631-093701da317d to /dev/vdb
Nov 06 23:00:37 user nova-compute[75000]: DEBUG os_brick.utils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50387274-8a71-48c2-ad15-0c5c479388b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b08c22-907e-4c02-8de7-9fe0b1c3eed2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd75a4f-c6bb-4d92-8ef2-54176310839e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1625f19f-15cf-4244-adeb-e7a0c1bb3053]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:00:37 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 23:00:37 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[166f40c2-7dfd-4c19-898c-4e5774037199]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG os_brick.utils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:00:37 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updating existing volume attachment record: b5fd11ed-2a3a-42ab-a5da-03dda1c82aed {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 23:00:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:44 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:53 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:56 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:00:56 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8470MB free_disk=24.86306381225586GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance ca8bfcc5-303e-450d-8cc3-69319dc4bd6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b71b11a1-bbcf-4086-8345-737863b9b45b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c68142ba-96c1-4444-94b2-594540013d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d6d43577-d118-4693-8a6a-92438ac00fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:00:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:00:57 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:00:57 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:00:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:00:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:00:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:00:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updating instance_info_cache with network_info: [{"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRjlWoyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:00:58 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:00:58 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:00:58 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[624c349c-9a76-40cb-956d-b77fea3e6c18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 23:00:58 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d821549-c1df-4002-b847-82694ee9bfed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9] added
Nov 06 23:00:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[db730a13-dbd6-4118-a7da-1914be12f71f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7ab5fd-4c6f-4499-b808-4e1cf1a19a13]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRjlWoyK {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRjlWoyK" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8487a47-f6b1-4933-bdaa-bd5043e7e689]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CRjlWoyK'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e657c258-1a75-456e-81ac-2250aeae6e6a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6715e7b0-ef3a-4d10-af3f-f552244359c5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:00:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:00:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b8f843-7724-4642-9ffa-7be80eda391f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9, portal: 172.16.0.220,3260]
Nov 06 23:00:58 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9, portal: 172.16.0.220,3260] successful.
Nov 06 23:00:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b1807-c30c-46cd-aa42-719c5bccd5d1]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a76308-8ef5-4b53-be0a-9401cb9ab258]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:00:58 user nova-compute[75000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)
Nov 06 23:00:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:00:58 user nova-compute[75000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)
Nov 06 23:00:58 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cf5d53-6dd7-4efb-8293-054052fd9e1d]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:00:58 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 23:00:59 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:00:59 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 23:00:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRjlWoyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 23:00:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:00:59 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26431383637646633', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:00:59 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431383637646633', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 23:01:00 user nova-compute[75000]: DEBUG nova.objects.instance [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'flavor' on Instance uuid c68142ba-96c1-4444-94b2-594540013d5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:01:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 23:01:00 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:01:00 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 23:01:00 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:01:00 user nova-compute[75000]:   <serial>68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9</serial>
Nov 06 23:01:00 user nova-compute[75000]: </disk>
Nov 06 23:01:00 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 23:01:00 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:01:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:01:00 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No VIF found with MAC fa:16:3e:82:f7:55, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 23:01:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-0beebc8e-ebe3-414d-9698-02c73452ced7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.121s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJXWLVHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:01:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:01:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:01:01 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[722e73de-a9e5-478f-8896-0ad4513016c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 23:01:01 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b56dc9f-9866-4310-9acf-03bdd2414cec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d] added
Nov 06 23:01:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bacf86-6e9c-4599-88ea-28ffef149f8b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f5553-0135-4a33-8fe1-99077186eef0]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJXWLVHb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJXWLVHb" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[061f4f1b-cbd9-42ec-9cd3-9b4501eac264]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CJXWLVHb'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae632d23-33c0-4768-93ca-9d780e3540dc]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beaf1cd-80dd-4b27-b24c-56ada0635e5a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:01 user nova-compute[75000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)
Nov 06 23:01:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:01 user nova-compute[75000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)
Nov 06 23:01:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a31721f-5118-4843-a805-bedd52f06d68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d, portal: 172.16.0.220,3260]
Nov 06 23:01:01 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d, portal: 172.16.0.220,3260] successful.
Nov 06 23:01:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0c4e4-c83c-4b79-99be-4249719a2c1d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe1b33d-7ba0-442f-ac98-8f5f6bdcf745]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:01 user nova-compute[75000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)
Nov 06 23:01:01 user nova-compute[75000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d (non-flash)
Nov 06 23:01:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:01 user nova-compute[75000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)
Nov 06 23:01:01 user nova-compute[75000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d (non-flash)
Nov 06 23:01:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f512972-65e7-4069-91ea-9a14139c4ef6]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJXWLVHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 23:01:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:01:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26461393266626337', 'path': '/dev/sdd'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:01:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461393266626337', 'path': '/dev/sdd'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 23:01:02 user nova-compute[75000]: DEBUG nova.objects.instance [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lazy-loading 'flavor' on Instance uuid b71b11a1-bbcf-4086-8345-737863b9b45b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:01:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 23:01:02 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:01:02 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 23:01:02 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:01:02 user nova-compute[75000]:   <serial>78e9b438-1190-48c8-b631-093701da317d</serial>
Nov 06 23:01:02 user nova-compute[75000]: </disk>
Nov 06 23:01:02 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 23:01:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:01:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:01:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] No VIF found with MAC fa:16:3e:37:66:c8, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 23:01:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-41a74ab4-c085-499f-a501-bac384f0dc44 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.194s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:03 user nova-compute[75000]: INFO nova.compute.manager [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Detaching volume 68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9
Nov 06 23:01:03 user nova-compute[75000]: INFO nova.virt.block_device [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Attempting to driver detach volume 68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 from mountpoint /dev/vdb
Nov 06 23:01:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Attempting to detach device vdb from instance c68142ba-96c1-4444-94b2-594540013d5f from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 23:01:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:01:03 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:01:03 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 23:01:03 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:01:03 user nova-compute[75000]:   <serial>68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9</serial>
Nov 06 23:01:03 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 23:01:03 user nova-compute[75000]: </disk>
Nov 06 23:01:03 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:01:03 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Successfully detached device vdb from instance c68142ba-96c1-4444-94b2-594540013d5f from the persistent domain config.
Nov 06 23:01:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c68142ba-96c1-4444-94b2-594540013d5f from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 23:01:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:01:03 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:01:03 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 23:01:03 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:01:03 user nova-compute[75000]:   <serial>68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9</serial>
Nov 06 23:01:03 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 23:01:03 user nova-compute[75000]: </disk>
Nov 06 23:01:03 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:01:03 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c68142ba-96c1-4444-94b2-594540013d5f {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 23:01:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:04 user nova-compute[75000]: INFO nova.compute.manager [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Detaching volume 78e9b438-1190-48c8-b631-093701da317d
Nov 06 23:01:04 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:04 user nova-compute[75000]: INFO nova.virt.block_device [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Attempting to driver detach volume 78e9b438-1190-48c8-b631-093701da317d from mountpoint /dev/vdb
Nov 06 23:01:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Attempting to detach device vdb from instance b71b11a1-bbcf-4086-8345-737863b9b45b from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 23:01:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:01:04 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:01:04 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 23:01:04 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:01:04 user nova-compute[75000]:   <serial>78e9b438-1190-48c8-b631-093701da317d</serial>
Nov 06 23:01:04 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 23:01:04 user nova-compute[75000]: </disk>
Nov 06 23:01:04 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:01:04 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Successfully detached device vdb from instance b71b11a1-bbcf-4086-8345-737863b9b45b from the persistent domain config.
Nov 06 23:01:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b71b11a1-bbcf-4086-8345-737863b9b45b from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 23:01:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:01:04 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:01:04 user nova-compute[75000]:   <source dev="/dev/sdd"/>
Nov 06 23:01:04 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:01:04 user nova-compute[75000]:   <serial>78e9b438-1190-48c8-b631-093701da317d</serial>
Nov 06 23:01:04 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 23:01:04 user nova-compute[75000]: </disk>
Nov 06 23:01:04 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:01:04 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b71b11a1-bbcf-4086-8345-737863b9b45b {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 23:01:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:09 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:14 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:19 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Verify base images {{(pid=75000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Image id 6d9a543f-0771-4d1e-8df7-834ea5778fb9 yields fingerprint 73dc6f77a3cf39e17ba774bf60562b48d7987340 {{(pid=75000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] image 6d9a543f-0771-4d1e-8df7-834ea5778fb9 at (/opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340): checking
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] image 6d9a543f-0771-4d1e-8df7-834ea5778fb9 at (/opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340): image is in use {{(pid=75000) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Image id cf3cd688-ea7b-402f-a42c-d141d8f6e4e9 yields fingerprint 98fd2b05784996bf3ac23b694d24f849e6ea84c9 {{(pid=75000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] image cf3cd688-ea7b-402f-a42c-d141d8f6e4e9 at (/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9): checking
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] image cf3cd688-ea7b-402f-a42c-d141d8f6e4e9 at (/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9): image is in use {{(pid=75000) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] c68142ba-96c1-4444-94b2-594540013d5f is a valid instance name {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] c68142ba-96c1-4444-94b2-594540013d5f has a disk file {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c68142ba-96c1-4444-94b2-594540013d5f is backed by 98fd2b05784996bf3ac23b694d24f849e6ea84c9 {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] ca8bfcc5-303e-450d-8cc3-69319dc4bd6e is a valid instance name {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] b71b11a1-bbcf-4086-8345-737863b9b45b is a valid instance name {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] b71b11a1-bbcf-4086-8345-737863b9b45b has a disk file {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b71b11a1-bbcf-4086-8345-737863b9b45b is backed by 98fd2b05784996bf3ac23b694d24f849e6ea84c9 {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] d6d43577-d118-4693-8a6a-92438ac00fc6 is a valid instance name {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] d6d43577-d118-4693-8a6a-92438ac00fc6 has a disk file {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d6d43577-d118-4693-8a6a-92438ac00fc6 is backed by 73dc6f77a3cf39e17ba774bf60562b48d7987340 {{(pid=75000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 06 23:01:21 user nova-compute[75000]: WARNING nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Unknown base file: /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9
Nov 06 23:01:21 user nova-compute[75000]: WARNING nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Unknown base file: /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4
Nov 06 23:01:21 user nova-compute[75000]: WARNING nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Unknown base file: /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9
Nov 06 23:01:21 user nova-compute[75000]: WARNING nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Unknown base file: /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b
Nov 06 23:01:21 user nova-compute[75000]: WARNING nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Unknown base file: /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef
Nov 06 23:01:21 user nova-compute[75000]: WARNING nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Unknown base file: /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Active base files: /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340 /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Removable base files: /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9 /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4 /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9 /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2c1a50f7ab46d036be5e4e2da774059058d107d9
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/810f37e366042aec470c90d5e9161624120ec7c4
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c249d87195cf219abb2bc26e363d08497b5267f9
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2f6832075b46992de27bee4578ee01623870291b
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/39803db4fba992a09bf136a780a875ac147de9ef
Nov 06 23:01:21 user nova-compute[75000]: INFO nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7910019615a65df34ddbe9e1706a14e2182451a5
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Verification complete {{(pid=75000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Verify swap images {{(pid=75000) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 06 23:01:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.imagecache [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Verify ephemeral images {{(pid=75000) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 06 23:01:23 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c68142ba-96c1-4444-94b2-594540013d5f is timed out.
Nov 06 23:01:23 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Successfully detached device vdb from instance c68142ba-96c1-4444-94b2-594540013d5f from the live domain config.
Nov 06 23:01:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRjlWoyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:01:23 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec374da2-12ed-45ae-a19f-935c58d0f878]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 23:01:23 user nova-compute[75000]: No targets found.
Nov 06 23:01:23 user nova-compute[75000]: iSNS:
Nov 06 23:01:23 user nova-compute[75000]: No targets found.
Nov 06 23:01:23 user nova-compute[75000]: STATIC:
Nov 06 23:01:23 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9
Nov 06 23:01:23 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:01:23 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:01:23 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d
Nov 06 23:01:23 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:01:23 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:01:23 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa
Nov 06 23:01:23 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:01:23 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:01:23 user nova-compute[75000]: FIRMWARE:
Nov 06 23:01:23 user nova-compute[75000]: No targets found.
Nov 06 23:01:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 23:01:23 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 23:01:23 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8057cefe-a311-4d63-a748-f99bd5ff0470]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc52715-6c25-4e0a-acf6-0a00ddfb1e0b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:23 user nova-compute[75000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)
Nov 06 23:01:23 user nova-compute[75000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d (non-flash)
Nov 06 23:01:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:23 user nova-compute[75000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 (non-flash)
Nov 06 23:01:23 user nova-compute[75000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d (non-flash)
Nov 06 23:01:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc1496c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3621d-7b81-4016-bff8-9a962fcb9e5c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0032de-74ba-4369-ad72-f5758b54ff39]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea04d4-48fe-42c2-bf4f-8120cf68a202]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec46a1d-1162-4aef-88e4-3f2f4dd2f2bb]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f59aa1-e246-41dc-9760-d0d1e45a8dbc]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1b9389-2f7f-4f17-a9cc-f712c1c5375a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9, portal: 172.16.0.220,3260]
Nov 06 23:01:23 user nova-compute[75000]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9, portal: 172.16.0.220,3260] successful.
Nov 06 23:01:23 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f1bb5f-15a4-4a22-97bc-a9c8612ea0f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fffd40-a766-4846-a9e1-40171dd873d7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] <== disconnect_volume: return (314ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:01:23 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG nova.objects.instance [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'flavor' on Instance uuid c68142ba-96c1-4444-94b2-594540013d5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:01:24 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b71b11a1-bbcf-4086-8345-737863b9b45b is timed out.
Nov 06 23:01:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Successfully detached device vdb from instance b71b11a1-bbcf-4086-8345-737863b9b45b from the live domain config.
Nov 06 23:01:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJXWLVHb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:01:24 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:01:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-38767ba7-c38b-43bb-800e-53a17c1cbf23 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.969s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63860b4-10d3-42c6-bdfa-96e3ffcb1116]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 23:01:24 user nova-compute[75000]: No targets found.
Nov 06 23:01:24 user nova-compute[75000]: iSNS:
Nov 06 23:01:24 user nova-compute[75000]: No targets found.
Nov 06 23:01:24 user nova-compute[75000]: STATIC:
Nov 06 23:01:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d
Nov 06 23:01:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:01:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:01:24 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa
Nov 06 23:01:24 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:01:24 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:01:24 user nova-compute[75000]: FIRMWARE:
Nov 06 23:01:24 user nova-compute[75000]: No targets found.
Nov 06 23:01:24 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 23:01:24 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 23:01:24 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 23:01:24 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdca60-eeed-420e-820e-9890a678e9f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e133c659-ad6c-4d47-b31e-ba62b342b3aa]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:25 user nova-compute[75000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d (non-flash)
Nov 06 23:01:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:25 user nova-compute[75000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d (non-flash)
Nov 06 23:01:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79fc2bc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d'): ({'sdd'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Removing single pathed devices sdd {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e07dfe-c42e-445c-918b-9a252c6d3c20]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6744f7eb-fe37-4f46-aaf0-72b1b4864023]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Flushing IO for device /dev/sdd {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6b7140-9070-4c3f-971d-ff479145c451]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cf77a6-f0a4-42c0-84f3-90594f2ef21f]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] SCSI volumes sdd have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa50e057-68c7-45bf-81d4-5a34d10a4ffb]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbaa10c-5d81-4cd0-9fac-6877918c7d88]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d, portal: 172.16.0.220,3260]
Nov 06 23:01:25 user nova-compute[75000]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d, portal: 172.16.0.220,3260] successful.
Nov 06 23:01:25 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e9b438-1190-48c8-b631-093701da317d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6a3c2d-4285-466b-a5b5-966c1a1763d6]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] <== disconnect_volume: return (294ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:01:25 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 23:01:26 user nova-compute[75000]: DEBUG nova.objects.instance [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lazy-loading 'flavor' on Instance uuid b71b11a1-bbcf-4086-8345-737863b9b45b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:01:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-08ca9d90-ff6d-456c-8aa3-51b82569e36b tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.866s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:01:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-6fe586c4-b8fa-4063-b955-764a13a5161a req-ddb2ce3e-dd0f-43a9-9549-9096b1da0533 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received event network-changed-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-6fe586c4-b8fa-4063-b955-764a13a5161a req-ddb2ce3e-dd0f-43a9-9549-9096b1da0533 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Refreshing instance network info cache due to event network-changed-26721731-4e40-4e7d-a3ba-cdff28678357. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6fe586c4-b8fa-4063-b955-764a13a5161a req-ddb2ce3e-dd0f-43a9-9549-9096b1da0533 service nova] Acquiring lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6fe586c4-b8fa-4063-b955-764a13a5161a req-ddb2ce3e-dd0f-43a9-9549-9096b1da0533 service nova] Acquired lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-6fe586c4-b8fa-4063-b955-764a13a5161a req-ddb2ce3e-dd0f-43a9-9549-9096b1da0533 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Refreshing network info cache for port 26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:41 user nova-compute[75000]: INFO nova.compute.manager [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Terminating instance
Nov 06 23:01:41 user nova-compute[75000]: DEBUG nova.compute.manager [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-ceec9287-2cb7-4e62-89c7-fdc5de869ade req-8bda393d-dc53-4bf5-8c75-5666af3858f9 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received event network-vif-unplugged-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ceec9287-2cb7-4e62-89c7-fdc5de869ade req-8bda393d-dc53-4bf5-8c75-5666af3858f9 service nova] Acquiring lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ceec9287-2cb7-4e62-89c7-fdc5de869ade req-8bda393d-dc53-4bf5-8c75-5666af3858f9 service nova] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ceec9287-2cb7-4e62-89c7-fdc5de869ade req-8bda393d-dc53-4bf5-8c75-5666af3858f9 service nova] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-ceec9287-2cb7-4e62-89c7-fdc5de869ade req-8bda393d-dc53-4bf5-8c75-5666af3858f9 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] No waiting events found dispatching network-vif-unplugged-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-ceec9287-2cb7-4e62-89c7-fdc5de869ade req-8bda393d-dc53-4bf5-8c75-5666af3858f9 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received event network-vif-unplugged-26721731-4e40-4e7d-a3ba-cdff28678357 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.network.neutron [req-6fe586c4-b8fa-4063-b955-764a13a5161a req-ddb2ce3e-dd0f-43a9-9549-9096b1da0533 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updated VIF entry in instance network info cache for port 26721731-4e40-4e7d-a3ba-cdff28678357. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.network.neutron [req-6fe586c4-b8fa-4063-b955-764a13a5161a req-ddb2ce3e-dd0f-43a9-9549-9096b1da0533 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updating instance_info_cache with network_info: [{"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-6fe586c4-b8fa-4063-b955-764a13a5161a req-ddb2ce3e-dd0f-43a9-9549-9096b1da0533 service nova] Releasing lock "refresh_cache-ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:01:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Instance destroyed successfully.
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.objects.instance [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lazy-loading 'resources' on Instance uuid ca8bfcc5-303e-450d-8cc3-69319dc4bd6e {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:56:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-901985789',display_name='tempest-TestVolumeBootPattern-server-901985789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-901985789',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3D/OAM/5YQAe11VPWv8oDc0xABKrvuAtt9KaN2spjr6XWdYKHlrJcCG8nUWAFETQvI9+ZcAWQjE9tlmsCZUTn3BwjK26nFHLyNit9WqhgP3juOx/+esRcOlreI5rjf3Q==',key_name='tempest-TestVolumeBootPattern-881632780',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='828fc01bb744496f83bd0f5d90e6924f',ramdisk_id='',reservation_id='r-cnxx7uqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-673062967',owner_user_name='tempest-TestVolumeBootPattern-673062967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:56:50Z,user_data=None,user_id='0d4aa96179fd4121ba224f47c01d9364',uuid=ca8bfcc5-303e-450d-8cc3-69319dc4bd6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converting VIF {"id": "26721731-4e40-4e7d-a3ba-cdff28678357", "address": "fa:16:3e:1a:8a:2a", "network": {"id": "4c74312e-fb03-4679-9435-a52ec13bee50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1600475604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "828fc01bb744496f83bd0f5d90e6924f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26721731-4e", "ovs_interfaceid": "26721731-4e40-4e7d-a3ba-cdff28678357", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:8a:2a,bridge_name='br-int',has_traffic_filtering=True,id=26721731-4e40-4e7d-a3ba-cdff28678357,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26721731-4e') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_vif [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:8a:2a,bridge_name='br-int',has_traffic_filtering=True,id=26721731-4e40-4e7d-a3ba-cdff28678357,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26721731-4e') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26721731-4e, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=923629af-9add-4417-9937-16b1acd4fc42) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:01:42 user nova-compute[75000]: INFO os_vif [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:8a:2a,bridge_name='br-int',has_traffic_filtering=True,id=26721731-4e40-4e7d-a3ba-cdff28678357,network=Network(4c74312e-fb03-4679-9435-a52ec13bee50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26721731-4e')
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhsKlar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:01:42 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33a3a95-5fbb-4463-a4c5-8ab2dc63e768]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 23:01:42 user nova-compute[75000]: No targets found.
Nov 06 23:01:42 user nova-compute[75000]: iSNS:
Nov 06 23:01:42 user nova-compute[75000]: No targets found.
Nov 06 23:01:42 user nova-compute[75000]: STATIC:
Nov 06 23:01:42 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa
Nov 06 23:01:42 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:01:42 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:01:42 user nova-compute[75000]: FIRMWARE:
Nov 06 23:01:42 user nova-compute[75000]: No targets found.
Nov 06 23:01:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 23:01:42 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 23:01:42 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f503c1f7-5907-4b57-95ea-929d16d43e9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cc3af3-26a9-4332-b556-5b792b647a1b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa (non-flash)
Nov 06 23:01:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc5db6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8f07eb-c78b-4a6c-afcb-4da8372f5a85]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e4419-aa0c-4047-8f80-7565eda6b3f1]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a521c4-38eb-4091-94e0-66b912964bf2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[946fbc0d-b274-4ad5-9dc8-93c947395ec6]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_dd0262dd', '/dev/disk/by-id/scsi-1SCST_BIOdd0262dd-ce6a2996a432fe4e', '/dev/disk/by-id/scsi-26365366132393936') {{(pid=86571) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fe0c4c-ee73-4f6a-8694-8b6ce758a140]: (4, None) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fe3832-750a-4a98-b78f-cd741f5a4abc]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a028c318-a681-42da-b8b1-115a89884545]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260]
Nov 06 23:01:42 user nova-compute[75000]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa, portal: 172.16.0.220,3260] successful.
Nov 06 23:01:42 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a1d51ea-511b-45a7-97bd-6e335ccbcafa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a182f415-d96a-4226-823d-020d99c9a6b9]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] <== disconnect_volume: return (292ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 23:01:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Deleting instance files /opt/stack/data/nova/instances/ca8bfcc5-303e-450d-8cc3-69319dc4bd6e_del
Nov 06 23:01:42 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Deletion of /opt/stack/data/nova/instances/ca8bfcc5-303e-450d-8cc3-69319dc4bd6e_del complete
Nov 06 23:01:42 user nova-compute[75000]: INFO nova.compute.manager [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 06 23:01:42 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 23:01:42 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 23:01:43 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:01:43 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Took 0.37 seconds to deallocate network for instance.
Nov 06 23:01:43 user nova-compute[75000]: DEBUG nova.compute.manager [req-1eaaa665-28a7-4128-88df-664d3efe46f3 req-1d818f1b-a83b-439f-b154-406a79e14841 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received event network-vif-deleted-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:01:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-061e234f-dbf6-4a17-8f2a-7542ac7ca670 req-3206355d-825a-46b2-9b79-35edc0420a84 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received event network-vif-plugged-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:01:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-061e234f-dbf6-4a17-8f2a-7542ac7ca670 req-3206355d-825a-46b2-9b79-35edc0420a84 service nova] Acquiring lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-061e234f-dbf6-4a17-8f2a-7542ac7ca670 req-3206355d-825a-46b2-9b79-35edc0420a84 service nova] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-061e234f-dbf6-4a17-8f2a-7542ac7ca670 req-3206355d-825a-46b2-9b79-35edc0420a84 service nova] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-061e234f-dbf6-4a17-8f2a-7542ac7ca670 req-3206355d-825a-46b2-9b79-35edc0420a84 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] No waiting events found dispatching network-vif-plugged-26721731-4e40-4e7d-a3ba-cdff28678357 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:01:44 user nova-compute[75000]: WARNING nova.compute.manager [req-061e234f-dbf6-4a17-8f2a-7542ac7ca670 req-3206355d-825a-46b2-9b79-35edc0420a84 service nova] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Received unexpected event network-vif-plugged-26721731-4e40-4e7d-a3ba-cdff28678357 for instance with vm_state active and task_state deleting.
Nov 06 23:01:44 user nova-compute[75000]: INFO nova.compute.manager [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] [instance: ca8bfcc5-303e-450d-8cc3-69319dc4bd6e] Took 0.86 seconds to detach 1 volumes for instance.
Nov 06 23:01:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:44 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:01:44 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:01:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:44 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Deleted allocations for instance ca8bfcc5-303e-450d-8cc3-69319dc4bd6e
Nov 06 23:01:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-1a3dada0-28e7-4811-bad4-397b648cd8a6 tempest-TestVolumeBootPattern-673062967 tempest-TestVolumeBootPattern-673062967-project-member] Lock "ca8bfcc5-303e-450d-8cc3-69319dc4bd6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.794s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:01:54 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:54 user nova-compute[75000]: DEBUG nova.objects.instance [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'flavor' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:55 user nova-compute[75000]: INFO nova.compute.manager [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Attaching volume b5444914-8f15-4d72-9e9d-88b150cfd184 to /dev/vdb
Nov 06 23:01:55 user nova-compute[75000]: DEBUG os_brick.utils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b76d8e-cf05-4fd7-a9a6-7dfebb7e4056]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e91397-4020-4cc2-912c-929a7224ad13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5d9716-5315-4eba-a9e1-8d9821691649]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1a53b-52e4-455e-b443-1a9c75237533]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid b71b11a1-bbcf-4086-8345-737863b9b45b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:01:55 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ed450d-aa68-4d18-848e-9769e7cf84a4]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG os_brick.utils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating existing volume attachment record: fcafa51e-d298-4514-a69f-184977c5f224 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updating instance_info_cache with network_info: [{"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-b71b11a1-bbcf-4086-8345-737863b9b45b" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:01:55 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:56 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:01:57 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:01:57 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:01:57 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=24.859996795654297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance b71b11a1-bbcf-4086-8345-737863b9b45b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c68142ba-96c1-4444-94b2-594540013d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d6d43577-d118-4693-8a6a-92438ac00fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:01:57 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:01:58 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:01:58 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:01:58 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:01:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:01:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:59 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:01:59 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 23:02:02 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:02 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:02 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:02:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:05 user nova-compute[75000]: INFO nova.compute.manager [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Terminating instance
Nov 06 23:02:05 user nova-compute[75000]: DEBUG nova.compute.manager [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-669f5864-b1ee-446f-91a6-36c87d7cf5a9 req-6bce42a1-22fa-4a64-bea4-ccd269d8ec58 service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received event network-vif-unplugged-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-669f5864-b1ee-446f-91a6-36c87d7cf5a9 req-6bce42a1-22fa-4a64-bea4-ccd269d8ec58 service nova] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-669f5864-b1ee-446f-91a6-36c87d7cf5a9 req-6bce42a1-22fa-4a64-bea4-ccd269d8ec58 service nova] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-669f5864-b1ee-446f-91a6-36c87d7cf5a9 req-6bce42a1-22fa-4a64-bea4-ccd269d8ec58 service nova] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-669f5864-b1ee-446f-91a6-36c87d7cf5a9 req-6bce42a1-22fa-4a64-bea4-ccd269d8ec58 service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] No waiting events found dispatching network-vif-unplugged-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:02:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-669f5864-b1ee-446f-91a6-36c87d7cf5a9 req-6bce42a1-22fa-4a64-bea4-ccd269d8ec58 service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received event network-vif-unplugged-c784391a-7528-4146-83d0-c3d432917d2b for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 23:02:06 user nova-compute[75000]: INFO nova.compute.manager [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] instance snapshotting
Nov 06 23:02:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Beginning live snapshot process
Nov 06 23:02:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Instance destroyed successfully.
Nov 06 23:02:06 user nova-compute[75000]: DEBUG nova.objects.instance [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lazy-loading 'resources' on Instance uuid b71b11a1-bbcf-4086-8345-737863b9b45b {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-703245323',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-703245323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7032453',id=48,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU1v+N9Mfg2FL9WurZVa8KiwHZXYd1AWu2YQMlFs8zkUI0l003fcBF2WPstv1+s6GcinsQofY/p/KPmFSZ9h4GsySfK7EuAZJcM3Z8aMRrCKQNCaAwLCTphsPYeiUos5g==',key_name='tempest-keypair-672412354',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:58:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e14abbdb2a949cca338930641269f13',ramdisk_id='',reservation_id='r-rh1aw71f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1149328702',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T22:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0054ae3babc0469ba831d736e05f1dd1',uuid=b71b11a1-bbcf-4086-8345-737863b9b45b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Converting VIF {"id": "c784391a-7528-4146-83d0-c3d432917d2b", "address": "fa:16:3e:37:66:c8", "network": {"id": "71acf388-9153-4bf5-9b0a-ee91f8e3fc60", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1382153965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e14abbdb2a949cca338930641269f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc784391a-75", "ovs_interfaceid": "c784391a-7528-4146-83d0-c3d432917d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:66:c8,bridge_name='br-int',has_traffic_filtering=True,id=c784391a-7528-4146-83d0-c3d432917d2b,network=Network(71acf388-9153-4bf5-9b0a-ee91f8e3fc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc784391a-75') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG os_vif [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:66:c8,bridge_name='br-int',has_traffic_filtering=True,id=c784391a-7528-4146-83d0-c3d432917d2b,network=Network(71acf388-9153-4bf5-9b0a-ee91f8e3fc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc784391a-75') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc784391a-75, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dfcecd8-73aa-4cb9-a164-6190e8b5db5f) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:06 user nova-compute[75000]: INFO os_vif [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:66:c8,bridge_name='br-int',has_traffic_filtering=True,id=c784391a-7528-4146-83d0-c3d432917d2b,network=Network(71acf388-9153-4bf5-9b0a-ee91f8e3fc60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc784391a-75')
Nov 06 23:02:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Deleting instance files /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b_del
Nov 06 23:02:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Deletion of /opt/stack/data/nova/instances/b71b11a1-bbcf-4086-8345-737863b9b45b_del complete
Nov 06 23:02:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json -f qcow2 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:06 user nova-compute[75000]: INFO nova.compute.manager [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 06 23:02:06 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json -f qcow2 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json -f qcow2" returned: 0 in 0.235s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:06 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg08sdbas/50dfdbfc9e924a9aa0d7461cf7e20b0d.delta 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98fd2b05784996bf3ac23b694d24f849e6ea84c9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpg08sdbas/50dfdbfc9e924a9aa0d7461cf7e20b0d.delta 1073741824" returned: 0 in 0.053s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:07 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 23:02:07 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-0045c14e-b11a-46a5-b866-143585825f8b req-f25c634c-290d-4f3b-b70b-a8f6abc2bc7d service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received event network-vif-deleted-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:07 user nova-compute[75000]: INFO nova.compute.manager [req-0045c14e-b11a-46a5-b866-143585825f8b req-f25c634c-290d-4f3b-b70b-a8f6abc2bc7d service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Neutron deleted interface c784391a-7528-4146-83d0-c3d432917d2b; detaching it from the instance and deleting it from the info cache
Nov 06 23:02:07 user nova-compute[75000]: DEBUG nova.network.neutron [req-0045c14e-b11a-46a5-b866-143585825f8b req-f25c634c-290d-4f3b-b70b-a8f6abc2bc7d service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:02:07 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Took 0.82 seconds to deallocate network for instance.
Nov 06 23:02:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-0045c14e-b11a-46a5-b866-143585825f8b req-f25c634c-290d-4f3b-b70b-a8f6abc2bc7d service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Detach interface failed, port_id=c784391a-7528-4146-83d0-c3d432917d2b, reason: Instance b71b11a1-bbcf-4086-8345-737863b9b45b could not be found. {{(pid=75000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:07 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Deleted allocations for instance b71b11a1-bbcf-4086-8345-737863b9b45b
Nov 06 23:02:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-424a9a0e-3770-4fa2-9ebb-9e211b7fcdb3 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702 tempest-TestServerVolumeAttachScenarioOldVersion-1149328702-project-member] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:07 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 23:02:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-8d3ca8f2-a2b5-429c-9e51-a272fa86a7e1 req-df23aa07-5485-40c4-a90f-e3f8b513c184 service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received event network-vif-plugged-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8d3ca8f2-a2b5-429c-9e51-a272fa86a7e1 req-df23aa07-5485-40c4-a90f-e3f8b513c184 service nova] Acquiring lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8d3ca8f2-a2b5-429c-9e51-a272fa86a7e1 req-df23aa07-5485-40c4-a90f-e3f8b513c184 service nova] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-8d3ca8f2-a2b5-429c-9e51-a272fa86a7e1 req-df23aa07-5485-40c4-a90f-e3f8b513c184 service nova] Lock "b71b11a1-bbcf-4086-8345-737863b9b45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:08 user nova-compute[75000]: DEBUG nova.compute.manager [req-8d3ca8f2-a2b5-429c-9e51-a272fa86a7e1 req-df23aa07-5485-40c4-a90f-e3f8b513c184 service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] No waiting events found dispatching network-vif-plugged-c784391a-7528-4146-83d0-c3d432917d2b {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:02:08 user nova-compute[75000]: WARNING nova.compute.manager [req-8d3ca8f2-a2b5-429c-9e51-a272fa86a7e1 req-df23aa07-5485-40c4-a90f-e3f8b513c184 service nova] [instance: b71b11a1-bbcf-4086-8345-737863b9b45b] Received unexpected event network-vif-plugged-c784391a-7528-4146-83d0-c3d432917d2b for instance with vm_state deleted and task_state None.
Nov 06 23:02:08 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 23:02:08 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 23:02:08 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 23:02:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg08sdbas/50dfdbfc9e924a9aa0d7461cf7e20b0d.delta /opt/stack/data/nova/instances/snapshots/tmpg08sdbas/50dfdbfc9e924a9aa0d7461cf7e20b0d {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:08 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpg08sdbas/50dfdbfc9e924a9aa0d7461cf7e20b0d.delta /opt/stack/data/nova/instances/snapshots/tmpg08sdbas/50dfdbfc9e924a9aa0d7461cf7e20b0d" returned: 0 in 0.446s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:08 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Snapshot extracted, beginning image upload
Nov 06 23:02:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:11 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Snapshot image upload complete
Nov 06 23:02:11 user nova-compute[75000]: INFO nova.compute.manager [None req-779a322a-85a2-49de-b06f-97d5b6bd3172 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Took 5.49 seconds to snapshot the instance on the hypervisor.
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 23:02:14 user nova-compute[75000]: INFO nova.compute.claims [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Claim successful on node user
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:14 user nova-compute[75000]: WARNING nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid c68142ba-96c1-4444-94b2-594540013d5f {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Triggering sync for uuid d26c36a1-6312-4189-9d51-c1cbf6b6ad82 {{(pid=75000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "c68142ba-96c1-4444-94b2-594540013d5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "c68142ba-96c1-4444-94b2-594540013d5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 23:02:14 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.policy [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10a609466eee4d45b45ed972ab1e93c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78c57cc47f84224a42fb08d00fc8985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 23:02:14 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Creating image(s)
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "/opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "/opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "/opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "fc859fb250f9d726b4556dbfff11a64c1797e7e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:14 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "fc859fb250f9d726b4556dbfff11a64c1797e7e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:15 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Successfully created port: 91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 23:02:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:15 user nova-compute[75000]: DEBUG nova.virt.images [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] 3bd70e9b-66cf-4e24-9eb3-e17b77e08454 was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 23:02:15 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 23:02:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0.part /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0.part /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0.converted" returned: 0 in 0.635s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Successfully updated port: 91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquired lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-87672e2b-5dd2-4623-b056-be52fdc9a27c req-23295974-43d1-448b-94a5-e3f5a4ec4b85 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received event network-changed-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG nova.compute.manager [req-87672e2b-5dd2-4623-b056-be52fdc9a27c req-23295974-43d1-448b-94a5-e3f5a4ec4b85 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Refreshing instance network info cache due to event network-changed-91653df9-a068-4608-9b16-b6787fc42db9. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87672e2b-5dd2-4623-b056-be52fdc9a27c req-23295974-43d1-448b-94a5-e3f5a4ec4b85 service nova] Acquiring lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "fc859fb250f9d726b4556dbfff11a64c1797e7e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.924s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0 --force-share --output=json" returned: 0 in 0.179s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "fc859fb250f9d726b4556dbfff11a64c1797e7e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "fc859fb250f9d726b4556dbfff11a64c1797e7e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG nova.network.neutron [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Updating instance_info_cache with network_info: [{"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Releasing lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Instance network_info: |[{"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87672e2b-5dd2-4623-b056-be52fdc9a27c req-23295974-43d1-448b-94a5-e3f5a4ec4b85 service nova] Acquired lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG nova.network.neutron [req-87672e2b-5dd2-4623-b056-be52fdc9a27c req-23295974-43d1-448b-94a5-e3f5a4ec4b85 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Refreshing network info cache for port 91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0 --force-share --output=json" returned: 0 in 0.184s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:16 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0,backing_fmt=raw /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0,backing_fmt=raw /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk 1073741824" returned: 0 in 0.051s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "fc859fb250f9d726b4556dbfff11a64c1797e7e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc859fb250f9d726b4556dbfff11a64c1797e7e0 --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Ensure instance console log exists: /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Start _get_guest_xml network_info=[{"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d02883da96bc5d9ac65214cce7d0f89b',container_format='bare',created_at=2023-11-06T23:02:06Z,direct_url=<?>,disk_format='qcow2',id=3bd70e9b-66cf-4e24-9eb3-e17b77e08454,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-728941141',owner='a78c57cc47f84224a42fb08d00fc8985',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T23:02:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '3bd70e9b-66cf-4e24-9eb3-e17b77e08454'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 23:02:17 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:02:17 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d02883da96bc5d9ac65214cce7d0f89b',container_format='bare',created_at=2023-11-06T23:02:06Z,direct_url=<?>,disk_format='qcow2',id=3bd70e9b-66cf-4e24-9eb3-e17b77e08454,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-728941141',owner='a78c57cc47f84224a42fb08d00fc8985',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T23:02:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T23:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-223432253',display_name='tempest-TestStampPattern-server-223432253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-223432253',id=51,image_ref='3bd70e9b-66cf-4e24-9eb3-e17b77e08454',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzd1TeUb9xHdATOiIf8dKGlOM1ny1WtLBC3p9frwKccZQb58JULy63qIiBmJZtsToMzop1wWDhsDsoTRzfqJCw9ayr51j7hxcgUkCCpFOabwgcVXQ2bATNmgOxvg5Ndug==',key_name='tempest-TestStampPattern-1915820448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78c57cc47f84224a42fb08d00fc8985',ramdisk_id='',reservation_id='r-4uyhmkoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c68142ba-96c1-4444-94b2-594540013d5f',image_min_disk='1',image_min_ram='0',image_owner_id='a78c57cc47f84224a42fb08d00fc8985',image_owner_project_name='tempest-TestStampPattern-1217219102',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1217219102-project-member',image_user_id='10a609466eee4d45b45ed972ab1e93c1',network_allocated='True',owner_project_name='tempest-TestStampPattern-1217219102',owner_user_name='tempest-TestStampPattern-1217219102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T23:02:15Z,user_data=None,user_id='10a609466eee4d45b45ed972ab1e93c1',uuid=d26c36a1-6312-4189-9d51-c1cbf6b6ad82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converting VIF {"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=91653df9-a068-4608-9b16-b6787fc42db9,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91653df9-a0') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.objects.instance [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'pci_devices' on Instance uuid d26c36a1-6312-4189-9d51-c1cbf6b6ad82 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] End _get_guest_xml xml=<domain type="kvm">
Nov 06 23:02:17 user nova-compute[75000]:   <uuid>d26c36a1-6312-4189-9d51-c1cbf6b6ad82</uuid>
Nov 06 23:02:17 user nova-compute[75000]:   <name>instance-00000033</name>
Nov 06 23:02:17 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 23:02:17 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 23:02:17 user nova-compute[75000]:   <metadata>
Nov 06 23:02:17 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 23:02:17 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 23:02:17 user nova-compute[75000]:       <nova:name>tempest-TestStampPattern-server-223432253</nova:name>
Nov 06 23:02:17 user nova-compute[75000]:       <nova:creationTime>2023-11-06 23:02:17</nova:creationTime>
Nov 06 23:02:17 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 23:02:17 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 23:02:17 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 23:02:17 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 23:02:17 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 23:02:17 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 23:02:17 user nova-compute[75000]:       </nova:flavor>
Nov 06 23:02:17 user nova-compute[75000]:       <nova:owner>
Nov 06 23:02:17 user nova-compute[75000]:         <nova:user uuid="10a609466eee4d45b45ed972ab1e93c1">tempest-TestStampPattern-1217219102-project-member</nova:user>
Nov 06 23:02:17 user nova-compute[75000]:         <nova:project uuid="a78c57cc47f84224a42fb08d00fc8985">tempest-TestStampPattern-1217219102</nova:project>
Nov 06 23:02:17 user nova-compute[75000]:       </nova:owner>
Nov 06 23:02:17 user nova-compute[75000]:       <nova:root type="image" uuid="3bd70e9b-66cf-4e24-9eb3-e17b77e08454"/>
Nov 06 23:02:17 user nova-compute[75000]:       <nova:ports>
Nov 06 23:02:17 user nova-compute[75000]:         <nova:port uuid="91653df9-a068-4608-9b16-b6787fc42db9">
Nov 06 23:02:17 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 23:02:17 user nova-compute[75000]:         </nova:port>
Nov 06 23:02:17 user nova-compute[75000]:       </nova:ports>
Nov 06 23:02:17 user nova-compute[75000]:     </nova:instance>
Nov 06 23:02:17 user nova-compute[75000]:   </metadata>
Nov 06 23:02:17 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 23:02:17 user nova-compute[75000]:     <system>
Nov 06 23:02:17 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 23:02:17 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 23:02:17 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 23:02:17 user nova-compute[75000]:       <entry name="serial">d26c36a1-6312-4189-9d51-c1cbf6b6ad82</entry>
Nov 06 23:02:17 user nova-compute[75000]:       <entry name="uuid">d26c36a1-6312-4189-9d51-c1cbf6b6ad82</entry>
Nov 06 23:02:17 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 23:02:17 user nova-compute[75000]:     </system>
Nov 06 23:02:17 user nova-compute[75000]:   </sysinfo>
Nov 06 23:02:17 user nova-compute[75000]:   <os>
Nov 06 23:02:17 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 23:02:17 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 23:02:17 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 23:02:17 user nova-compute[75000]:   </os>
Nov 06 23:02:17 user nova-compute[75000]:   <features>
Nov 06 23:02:17 user nova-compute[75000]:     <acpi/>
Nov 06 23:02:17 user nova-compute[75000]:     <apic/>
Nov 06 23:02:17 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 23:02:17 user nova-compute[75000]:   </features>
Nov 06 23:02:17 user nova-compute[75000]:   <clock offset="utc">
Nov 06 23:02:17 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 23:02:17 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 23:02:17 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 23:02:17 user nova-compute[75000]:   </clock>
Nov 06 23:02:17 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 23:02:17 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 23:02:17 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 23:02:17 user nova-compute[75000]:   </cpu>
Nov 06 23:02:17 user nova-compute[75000]:   <devices>
Nov 06 23:02:17 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 23:02:17 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 23:02:17 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk"/>
Nov 06 23:02:17 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 23:02:17 user nova-compute[75000]:     </disk>
Nov 06 23:02:17 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 23:02:17 user nova-compute[75000]:       <mac address="fa:16:3e:0c:6d:9e"/>
Nov 06 23:02:17 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 23:02:17 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 23:02:17 user nova-compute[75000]:       <target dev="tap91653df9-a0"/>
Nov 06 23:02:17 user nova-compute[75000]:     </interface>
Nov 06 23:02:17 user nova-compute[75000]:     <serial type="pty">
Nov 06 23:02:17 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/console.log" append="off"/>
Nov 06 23:02:17 user nova-compute[75000]:     </serial>
Nov 06 23:02:17 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 23:02:17 user nova-compute[75000]:     <video>
Nov 06 23:02:17 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 23:02:17 user nova-compute[75000]:     </video>
Nov 06 23:02:17 user nova-compute[75000]:     <rng model="virtio">
Nov 06 23:02:17 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 23:02:17 user nova-compute[75000]:     </rng>
Nov 06 23:02:17 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 23:02:17 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 23:02:17 user nova-compute[75000]:       <stats period="10"/>
Nov 06 23:02:17 user nova-compute[75000]:     </memballoon>
Nov 06 23:02:17 user nova-compute[75000]:   </devices>
Nov 06 23:02:17 user nova-compute[75000]: </domain>
Nov 06 23:02:17 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T23:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-223432253',display_name='tempest-TestStampPattern-server-223432253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-223432253',id=51,image_ref='3bd70e9b-66cf-4e24-9eb3-e17b77e08454',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzd1TeUb9xHdATOiIf8dKGlOM1ny1WtLBC3p9frwKccZQb58JULy63qIiBmJZtsToMzop1wWDhsDsoTRzfqJCw9ayr51j7hxcgUkCCpFOabwgcVXQ2bATNmgOxvg5Ndug==',key_name='tempest-TestStampPattern-1915820448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a78c57cc47f84224a42fb08d00fc8985',ramdisk_id='',reservation_id='r-4uyhmkoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c68142ba-96c1-4444-94b2-594540013d5f',image_min_disk='1',image_min_ram='0',image_owner_id='a78c57cc47f84224a42fb08d00fc8985',image_owner_project_name='tempest-TestStampPattern-1217219102',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1217219102-project-member',image_user_id='10a609466eee4d45b45ed972ab1e93c1',network_allocated='True',owner_project_name='tempest-TestStampPattern-1217219102',owner_user_name='tempest-TestStampPattern-1217219102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T23:02:15Z,user_data=None,user_id='10a609466eee4d45b45ed972ab1e93c1',uuid=d26c36a1-6312-4189-9d51-c1cbf6b6ad82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converting VIF {"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=91653df9-a068-4608-9b16-b6787fc42db9,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91653df9-a0') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG os_vif [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=91653df9-a068-4608-9b16-b6787fc42db9,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91653df9-a0') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eee002b2-ee28-5750-bc4d-75524ae691e6', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91653df9-a0, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91653df9-a0, col_values=(('qos', UUID('69e5fb26-cd56-49f2-aad2-35f5e52df2f1')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91653df9-a0, col_values=(('external_ids', {'iface-id': '91653df9-a068-4608-9b16-b6787fc42db9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:6d:9e', 'vm-uuid': 'd26c36a1-6312-4189-9d51-c1cbf6b6ad82'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:17 user nova-compute[75000]: INFO os_vif [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=91653df9-a068-4608-9b16-b6787fc42db9,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91653df9-a0')
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No VIF found with MAC fa:16:3e:0c:6d:9e, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.network.neutron [req-87672e2b-5dd2-4623-b056-be52fdc9a27c req-23295974-43d1-448b-94a5-e3f5a4ec4b85 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Updated VIF entry in instance network info cache for port 91653df9-a068-4608-9b16-b6787fc42db9. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.network.neutron [req-87672e2b-5dd2-4623-b056-be52fdc9a27c req-23295974-43d1-448b-94a5-e3f5a4ec4b85 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Updating instance_info_cache with network_info: [{"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87672e2b-5dd2-4623-b056-be52fdc9a27c req-23295974-43d1-448b-94a5-e3f5a4ec4b85 service nova] Releasing lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAnWBvzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:02:17 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:02:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:02:17 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:02:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:02:17 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:02:17 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 23:02:17 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d37622e-96b8-42a4-b268-467ee099b4db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 23:02:18 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ef2955-c5e2-49cc-802d-749d461ab972]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184] added
Nov 06 23:02:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1822e857-c692-4c1b-aad1-332648e7885a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8761d3c9-020b-41f9-ba2b-7da2d746ca48]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iAnWBvzC {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iAnWBvzC" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5451874-f39b-4628-b178-55be0e38d909]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iAnWBvzC'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[552daf54-efbf-4729-81d7-4dd021748616]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b30724a-78e4-413f-ade3-28d11dbbf7fc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 23:02:18 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 23:02:18 user nova-compute[75000]:  {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:02:18 user nova-compute[75000]: WARNING os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 23:02:18 user nova-compute[75000]: 
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3450dd5-d60c-4f33-bcc5-f3752e3ea44d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260]
Nov 06 23:02:18 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260] successful.
Nov 06 23:02:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1876211-b85e-4900-8794-6fdd32903b1c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf091e16-b5d4-49b2-8174-0c0b488e20a9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:02:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:02:18 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d72521d-917c-43c2-b18b-71f03424b496]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAnWBvzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-b8044a12-b419-4e0c-b8c1-4f7570336047 req-49756847-78a6-4f7b-a7e5-eb15a2bf5aa6 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received event network-vif-plugged-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b8044a12-b419-4e0c-b8c1-4f7570336047 req-49756847-78a6-4f7b-a7e5-eb15a2bf5aa6 service nova] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b8044a12-b419-4e0c-b8c1-4f7570336047 req-49756847-78a6-4f7b-a7e5-eb15a2bf5aa6 service nova] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b8044a12-b419-4e0c-b8c1-4f7570336047 req-49756847-78a6-4f7b-a7e5-eb15a2bf5aa6 service nova] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:18 user nova-compute[75000]: DEBUG nova.compute.manager [req-b8044a12-b419-4e0c-b8c1-4f7570336047 req-49756847-78a6-4f7b-a7e5-eb15a2bf5aa6 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] No waiting events found dispatching network-vif-plugged-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:02:18 user nova-compute[75000]: WARNING nova.compute.manager [req-b8044a12-b419-4e0c-b8c1-4f7570336047 req-49756847-78a6-4f7b-a7e5-eb15a2bf5aa6 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received unexpected event network-vif-plugged-91653df9-a068-4608-9b16-b6787fc42db9 for instance with vm_state building and task_state spawning.
Nov 06 23:02:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23662643638326636', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662643638326636', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG nova.objects.instance [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'flavor' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 23:02:19 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:02:19 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 23:02:19 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:02:19 user nova-compute[75000]:   <serial>b5444914-8f15-4d72-9e9d-88b150cfd184</serial>
Nov 06 23:02:19 user nova-compute[75000]: </disk>
Nov 06 23:02:19 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No VIF found with MAC fa:16:3e:c1:ad:45, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b124549c-3f09-4b25-9c74-897bd947dedc tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.749s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.612s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:19 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-dbc9da2b-8ea4-425a-8bc9-cb78a47b6e27 req-428c5622-0806-4972-8fa8-376a7f360dcc service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received event network-vif-plugged-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dbc9da2b-8ea4-425a-8bc9-cb78a47b6e27 req-428c5622-0806-4972-8fa8-376a7f360dcc service nova] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dbc9da2b-8ea4-425a-8bc9-cb78a47b6e27 req-428c5622-0806-4972-8fa8-376a7f360dcc service nova] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:20 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-dbc9da2b-8ea4-425a-8bc9-cb78a47b6e27 req-428c5622-0806-4972-8fa8-376a7f360dcc service nova] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:20 user nova-compute[75000]: DEBUG nova.compute.manager [req-dbc9da2b-8ea4-425a-8bc9-cb78a47b6e27 req-428c5622-0806-4972-8fa8-376a7f360dcc service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] No waiting events found dispatching network-vif-plugged-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:02:20 user nova-compute[75000]: WARNING nova.compute.manager [req-dbc9da2b-8ea4-425a-8bc9-cb78a47b6e27 req-428c5622-0806-4972-8fa8-376a7f360dcc service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received unexpected event network-vif-plugged-91653df9-a068-4608-9b16-b6787fc42db9 for instance with vm_state building and task_state spawning.
Nov 06 23:02:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 23:02:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 23:02:21 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Instance spawned successfully.
Nov 06 23:02:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 23:02:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:02:21 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:02:21 user nova-compute[75000]: INFO nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 06 23:02:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 23:02:21 user nova-compute[75000]: INFO nova.compute.manager [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Took 7.05 seconds to build instance.
Nov 06 23:02:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-c7cf38ec-be2d-4c08-911d-589a4a374d53 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.147s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.845s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:21 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:02:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:02:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:02:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:02:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:02:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:02:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:33 user nova-compute[75000]: DEBUG nova.compute.manager [req-9fb40bd4-2cb4-421e-8767-6a8caad335ab req-2b2cd436-201a-49b8-b3cd-fba020e94814 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:33 user nova-compute[75000]: DEBUG nova.compute.manager [req-9fb40bd4-2cb4-421e-8767-6a8caad335ab req-2b2cd436-201a-49b8-b3cd-fba020e94814 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing instance network info cache due to event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:02:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9fb40bd4-2cb4-421e-8767-6a8caad335ab req-2b2cd436-201a-49b8-b3cd-fba020e94814 service nova] Acquiring lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:02:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9fb40bd4-2cb4-421e-8767-6a8caad335ab req-2b2cd436-201a-49b8-b3cd-fba020e94814 service nova] Acquired lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:02:33 user nova-compute[75000]: DEBUG nova.network.neutron [req-9fb40bd4-2cb4-421e-8767-6a8caad335ab req-2b2cd436-201a-49b8-b3cd-fba020e94814 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing network info cache for port a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:02:34 user nova-compute[75000]: DEBUG nova.network.neutron [req-9fb40bd4-2cb4-421e-8767-6a8caad335ab req-2b2cd436-201a-49b8-b3cd-fba020e94814 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updated VIF entry in instance network info cache for port a7d95d6d-f5c0-43c1-8be1-bbe2798779ca. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:02:34 user nova-compute[75000]: DEBUG nova.network.neutron [req-9fb40bd4-2cb4-421e-8767-6a8caad335ab req-2b2cd436-201a-49b8-b3cd-fba020e94814 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating instance_info_cache with network_info: [{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:02:34 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-9fb40bd4-2cb4-421e-8767-6a8caad335ab req-2b2cd436-201a-49b8-b3cd-fba020e94814 service nova] Releasing lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:02:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-3924d028-e309-44b4-9bb2-52414a108307 req-9020e2c3-38e8-4958-9a97-34663fb48d04 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:35 user nova-compute[75000]: DEBUG nova.compute.manager [req-3924d028-e309-44b4-9bb2-52414a108307 req-9020e2c3-38e8-4958-9a97-34663fb48d04 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing instance network info cache due to event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:02:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3924d028-e309-44b4-9bb2-52414a108307 req-9020e2c3-38e8-4958-9a97-34663fb48d04 service nova] Acquiring lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:02:35 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3924d028-e309-44b4-9bb2-52414a108307 req-9020e2c3-38e8-4958-9a97-34663fb48d04 service nova] Acquired lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:02:35 user nova-compute[75000]: DEBUG nova.network.neutron [req-3924d028-e309-44b4-9bb2-52414a108307 req-9020e2c3-38e8-4958-9a97-34663fb48d04 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing network info cache for port a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:02:36 user nova-compute[75000]: DEBUG nova.network.neutron [req-3924d028-e309-44b4-9bb2-52414a108307 req-9020e2c3-38e8-4958-9a97-34663fb48d04 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updated VIF entry in instance network info cache for port a7d95d6d-f5c0-43c1-8be1-bbe2798779ca. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:02:36 user nova-compute[75000]: DEBUG nova.network.neutron [req-3924d028-e309-44b4-9bb2-52414a108307 req-9020e2c3-38e8-4958-9a97-34663fb48d04 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating instance_info_cache with network_info: [{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:02:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3924d028-e309-44b4-9bb2-52414a108307 req-9020e2c3-38e8-4958-9a97-34663fb48d04 service nova] Releasing lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:02:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:48 user nova-compute[75000]: INFO nova.compute.manager [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Rebooting instance
Nov 06 23:02:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:02:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquired lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:02:48 user nova-compute[75000]: DEBUG nova.network.neutron [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 23:02:48 user nova-compute[75000]: DEBUG nova.network.neutron [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating instance_info_cache with network_info: [{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:02:48 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Releasing lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:02:48 user nova-compute[75000]: DEBUG nova.compute.manager [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-72fe05a7-a056-4eb5-893d-475f759094a6 req-f81c9773-d8e7-4df1-94d3-b6c70f749551 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-unplugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-72fe05a7-a056-4eb5-893d-475f759094a6 req-f81c9773-d8e7-4df1-94d3-b6c70f749551 service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-72fe05a7-a056-4eb5-893d-475f759094a6 req-f81c9773-d8e7-4df1-94d3-b6c70f749551 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-72fe05a7-a056-4eb5-893d-475f759094a6 req-f81c9773-d8e7-4df1-94d3-b6c70f749551 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG nova.compute.manager [req-72fe05a7-a056-4eb5-893d-475f759094a6 req-f81c9773-d8e7-4df1-94d3-b6c70f749551 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-unplugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:02:49 user nova-compute[75000]: WARNING nova.compute.manager [req-72fe05a7-a056-4eb5-893d-475f759094a6 req-f81c9773-d8e7-4df1-94d3-b6c70f749551 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-unplugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state active and task_state reboot_started_hard.
Nov 06 23:02:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:49 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Instance destroyed successfully.
Nov 06 23:02:49 user nova-compute[75000]: DEBUG nova.objects.instance [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'resources' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-149096020',display_name='tempest-TestMinimumBasicScenario-server-149096020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-149096020',id=50,image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf8Qv+8D2Gx514+yZ6HpuGxtKZuGQ+2lFjKMN0XpMLqz1WbCbwaE9mBBqm6fCPckDfpijGPupQZaYw1GGnNgZHiEmTXOLz0I5k7ftQfIH79R7DjaX+O29XUxrgz0ny7Aw==',key_name='tempest-TestMinimumBasicScenario-479337453',keypairs=<?>,launch_index=0,launched_at=2023-11-06T23:00:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e5d66722e747c98e9b1eb57915287d',ramdisk_id='',reservation_id='r-24d7l7ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1418906334',owner_user_name='tempest-TestMinimumBasicScenario-1418906334-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T23:02:49Z,user_data=None,user_id='1da9d6a0e8f14304b3d15b89d3d19ebc',uuid=d6d43577-d118-4693-8a6a-92438ac00fc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converting VIF {"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:02:49 user nova-compute[75000]: DEBUG os_vif [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7d95d6d-f5, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e963e1b4-f814-44b1-bc65-278003dcc242) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:50 user nova-compute[75000]: INFO os_vif [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5')
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAnWBvzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:02:50 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dababa-9ea4-4e23-b61b-75326d967db2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 23:02:50 user nova-compute[75000]: No targets found.
Nov 06 23:02:50 user nova-compute[75000]: iSNS:
Nov 06 23:02:50 user nova-compute[75000]: No targets found.
Nov 06 23:02:50 user nova-compute[75000]: STATIC:
Nov 06 23:02:50 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184
Nov 06 23:02:50 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:02:50 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:02:50 user nova-compute[75000]: FIRMWARE:
Nov 06 23:02:50 user nova-compute[75000]: No targets found.
Nov 06 23:02:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 23:02:50 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 23:02:50 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f968a1e-f244-4999-9674-86ec98192377]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd6061c-f725-4933-a69b-4e011f817043]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:02:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:02:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc2963b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0479f2ab-5815-45c8-9c16-1c65b68e9ece]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0191ee89-96fd-434e-ae5f-ecc5468a3279]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc0b96-0145-4b2c-b725-ea54c51221b8]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[049f7395-21cd-4f97-ad55-cdcce012c7f7]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a89f051-c09d-44af-8dc4-e09292854a1e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf11e6bb-da2a-4c23-87ee-b19fea71c2ad]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260]
Nov 06 23:02:50 user nova-compute[75000]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260] successful.
Nov 06 23:02:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf70ca6-3598-44e0-85f5-88d5672d1a6c]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] <== disconnect_volume: return (303ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Start _get_guest_xml network_info=[{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6d9a543f-0771-4d1e-8df7-834ea5778fb9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '6d9a543f-0771-4d1e-8df7-834ea5778fb9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAnWBvzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd6d43577-d118-4693-8a6a-92438ac00fc6', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5444914-8f15-4d72-9e9d-88b150cfd184', 'serial': 'b5444914-8f15-4d72-9e9d-88b150cfd184'}, 'attachment_id': 'fcafa51e-d298-4514-a69f-184977c5f224', 'device_type': 'disk', 'volume_type': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 23:02:50 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:02:50 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6d9a543f-0771-4d1e-8df7-834ea5778fb9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.objects.instance [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.objects.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Object Instance<d6d43577-d118-4693-8a6a-92438ac00fc6> lazy-loaded attributes: resources,vcpu_model {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAnWBvzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:02:50 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:02:50 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:02:50 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1268dd-6d64-4117-8aee-53e53265c144]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 23:02:50 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8c2cc7-7e48-4d0c-bbe5-ac87ea5c5287]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184] added
Nov 06 23:02:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38a66a9-d100-40e8-82bb-15c36050eda5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc712368-4048-41c6-9195-a5a62c0d0e0d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iAnWBvzC {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iAnWBvzC" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80428b94-bb49-4d3a-98fb-f4a03814cbb2]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iAnWBvzC'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d72dbf-1647-49e3-89fe-c5a0e4d7de53]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c1bb37-5b48-4b47-916a-f32a636da1d9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 23:02:50 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 23:02:50 user nova-compute[75000]:  {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:02:50 user nova-compute[75000]: WARNING os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 23:02:50 user nova-compute[75000]: 
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9399afe-6329-4752-a60a-183a3241e5f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260]
Nov 06 23:02:50 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260] successful.
Nov 06 23:02:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d8ca60-1a4a-4570-9636-3f64cb17ef26]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf012e78-037a-4522-9ad3-d5f61e515247]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:02:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:02:50 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef150483-0faf-43a0-9e62-76637c705eb0]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 23:02:50 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAnWBvzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-4392766c-21af-4f14-ae4d-a285c4b2fe9b req-528d977c-83f5-4a29-8e94-41da1d1d8d17 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4392766c-21af-4f14-ae4d-a285c4b2fe9b req-528d977c-83f5-4a29-8e94-41da1d1d8d17 service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4392766c-21af-4f14-ae4d-a285c4b2fe9b req-528d977c-83f5-4a29-8e94-41da1d1d8d17 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4392766c-21af-4f14-ae4d-a285c4b2fe9b req-528d977c-83f5-4a29-8e94-41da1d1d8d17 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG nova.compute.manager [req-4392766c-21af-4f14-ae4d-a285c4b2fe9b req-528d977c-83f5-4a29-8e94-41da1d1d8d17 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:02:51 user nova-compute[75000]: WARNING nova.compute.manager [req-4392766c-21af-4f14-ae4d-a285c4b2fe9b req-528d977c-83f5-4a29-8e94-41da1d1d8d17 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state active and task_state reboot_started_hard.
Nov 06 23:02:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23662643638326636', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662643638326636', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-149096020',display_name='tempest-TestMinimumBasicScenario-server-149096020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-149096020',id=50,image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf8Qv+8D2Gx514+yZ6HpuGxtKZuGQ+2lFjKMN0XpMLqz1WbCbwaE9mBBqm6fCPckDfpijGPupQZaYw1GGnNgZHiEmTXOLz0I5k7ftQfIH79R7DjaX+O29XUxrgz0ny7Aw==',key_name='tempest-TestMinimumBasicScenario-479337453',keypairs=<?>,launch_index=0,launched_at=2023-11-06T23:00:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e5d66722e747c98e9b1eb57915287d',ramdisk_id='',reservation_id='r-24d7l7ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1418906334',owner_user_name='tempest-TestMinimumBasicScenario-1418906334-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T23:02:49Z,user_data=None,user_id='1da9d6a0e8f14304b3d15b89d3d19ebc',uuid=d6d43577-d118-4693-8a6a-92438ac00fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converting VIF {"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG nova.objects.instance [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'pci_devices' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG nova.objects.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Object Instance<d6d43577-d118-4693-8a6a-92438ac00fc6> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 23:02:51 user nova-compute[75000]:   <uuid>d6d43577-d118-4693-8a6a-92438ac00fc6</uuid>
Nov 06 23:02:51 user nova-compute[75000]:   <name>instance-00000032</name>
Nov 06 23:02:51 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 23:02:51 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 23:02:51 user nova-compute[75000]:   <metadata>
Nov 06 23:02:51 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 23:02:51 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 23:02:51 user nova-compute[75000]:       <nova:name>tempest-TestMinimumBasicScenario-server-149096020</nova:name>
Nov 06 23:02:51 user nova-compute[75000]:       <nova:creationTime>2023-11-06 23:02:50</nova:creationTime>
Nov 06 23:02:51 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 23:02:51 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 23:02:51 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 23:02:51 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 23:02:51 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 23:02:51 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 23:02:51 user nova-compute[75000]:       </nova:flavor>
Nov 06 23:02:51 user nova-compute[75000]:       <nova:owner>
Nov 06 23:02:51 user nova-compute[75000]:         <nova:user uuid="1da9d6a0e8f14304b3d15b89d3d19ebc">tempest-TestMinimumBasicScenario-1418906334-project-member</nova:user>
Nov 06 23:02:51 user nova-compute[75000]:         <nova:project uuid="87e5d66722e747c98e9b1eb57915287d">tempest-TestMinimumBasicScenario-1418906334</nova:project>
Nov 06 23:02:51 user nova-compute[75000]:       </nova:owner>
Nov 06 23:02:51 user nova-compute[75000]:       <nova:root type="image" uuid="6d9a543f-0771-4d1e-8df7-834ea5778fb9"/>
Nov 06 23:02:51 user nova-compute[75000]:       <nova:ports>
Nov 06 23:02:51 user nova-compute[75000]:         <nova:port uuid="a7d95d6d-f5c0-43c1-8be1-bbe2798779ca">
Nov 06 23:02:51 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 23:02:51 user nova-compute[75000]:         </nova:port>
Nov 06 23:02:51 user nova-compute[75000]:       </nova:ports>
Nov 06 23:02:51 user nova-compute[75000]:     </nova:instance>
Nov 06 23:02:51 user nova-compute[75000]:   </metadata>
Nov 06 23:02:51 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 23:02:51 user nova-compute[75000]:     <system>
Nov 06 23:02:51 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 23:02:51 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 23:02:51 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 23:02:51 user nova-compute[75000]:       <entry name="serial">d6d43577-d118-4693-8a6a-92438ac00fc6</entry>
Nov 06 23:02:51 user nova-compute[75000]:       <entry name="uuid">d6d43577-d118-4693-8a6a-92438ac00fc6</entry>
Nov 06 23:02:51 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 23:02:51 user nova-compute[75000]:     </system>
Nov 06 23:02:51 user nova-compute[75000]:   </sysinfo>
Nov 06 23:02:51 user nova-compute[75000]:   <os>
Nov 06 23:02:51 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 23:02:51 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 23:02:51 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 23:02:51 user nova-compute[75000]:   </os>
Nov 06 23:02:51 user nova-compute[75000]:   <features>
Nov 06 23:02:51 user nova-compute[75000]:     <acpi/>
Nov 06 23:02:51 user nova-compute[75000]:     <apic/>
Nov 06 23:02:51 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 23:02:51 user nova-compute[75000]:   </features>
Nov 06 23:02:51 user nova-compute[75000]:   <clock offset="utc">
Nov 06 23:02:51 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 23:02:51 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 23:02:51 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 23:02:51 user nova-compute[75000]:   </clock>
Nov 06 23:02:51 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 23:02:51 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 23:02:51 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 23:02:51 user nova-compute[75000]:   </cpu>
Nov 06 23:02:51 user nova-compute[75000]:   <devices>
Nov 06 23:02:51 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 23:02:51 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 23:02:51 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk"/>
Nov 06 23:02:51 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 23:02:51 user nova-compute[75000]:     </disk>
Nov 06 23:02:51 user nova-compute[75000]:     <disk type="block" device="disk">
Nov 06 23:02:51 user nova-compute[75000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:02:51 user nova-compute[75000]:       <source dev="/dev/sdb"/>
Nov 06 23:02:51 user nova-compute[75000]:       <target dev="vdb" bus="virtio"/>
Nov 06 23:02:51 user nova-compute[75000]:       <serial>b5444914-8f15-4d72-9e9d-88b150cfd184</serial>
Nov 06 23:02:51 user nova-compute[75000]:     </disk>
Nov 06 23:02:51 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 23:02:51 user nova-compute[75000]:       <mac address="fa:16:3e:c1:ad:45"/>
Nov 06 23:02:51 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 23:02:51 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 23:02:51 user nova-compute[75000]:       <target dev="tapa7d95d6d-f5"/>
Nov 06 23:02:51 user nova-compute[75000]:     </interface>
Nov 06 23:02:51 user nova-compute[75000]:     <serial type="pty">
Nov 06 23:02:51 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/console.log" append="off"/>
Nov 06 23:02:51 user nova-compute[75000]:     </serial>
Nov 06 23:02:51 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 23:02:51 user nova-compute[75000]:     <video>
Nov 06 23:02:51 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 23:02:51 user nova-compute[75000]:     </video>
Nov 06 23:02:51 user nova-compute[75000]:     <rng model="virtio">
Nov 06 23:02:51 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 23:02:51 user nova-compute[75000]:     </rng>
Nov 06 23:02:51 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 23:02:51 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 23:02:51 user nova-compute[75000]:       <stats period="10"/>
Nov 06 23:02:51 user nova-compute[75000]:     </memballoon>
Nov 06 23:02:51 user nova-compute[75000]:   </devices>
Nov 06 23:02:51 user nova-compute[75000]: </domain>
Nov 06 23:02:51 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:51 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.objects.instance [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'trusted_certs' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.objects.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Object Instance<d6d43577-d118-4693-8a6a-92438ac00fc6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340 --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73dc6f77a3cf39e17ba774bf60562b48d7987340 --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Cannot resize image /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.objects.instance [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'migration_context' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.objects.base [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Object Instance<d6d43577-d118-4693-8a6a-92438ac00fc6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75000) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-149096020',display_name='tempest-TestMinimumBasicScenario-server-149096020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-149096020',id=50,image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf8Qv+8D2Gx514+yZ6HpuGxtKZuGQ+2lFjKMN0XpMLqz1WbCbwaE9mBBqm6fCPckDfpijGPupQZaYw1GGnNgZHiEmTXOLz0I5k7ftQfIH79R7DjaX+O29XUxrgz0ny7Aw==',key_name='tempest-TestMinimumBasicScenario-479337453',keypairs=<?>,launch_index=0,launched_at=2023-11-06T23:00:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='87e5d66722e747c98e9b1eb57915287d',ramdisk_id='',reservation_id='r-24d7l7ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1418906334',owner_user_name='tempest-TestMinimumBasicScenario-1418906334-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T23:02:49Z,user_data=None,user_id='1da9d6a0e8f14304b3d15b89d3d19ebc',uuid=d6d43577-d118-4693-8a6a-92438ac00fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converting VIF {"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG os_vif [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '147ed6dc-28a8-5937-8c93-3f8b5efed9bd', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7d95d6d-f5, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7d95d6d-f5, col_values=(('qos', UUID('b4300225-496e-4f94-b02c-91dae0e9fabe')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7d95d6d-f5, col_values=(('external_ids', {'iface-id': 'a7d95d6d-f5c0-43c1-8be1-bbe2798779ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:ad:45', 'vm-uuid': 'd6d43577-d118-4693-8a6a-92438ac00fc6'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:02:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:52 user nova-compute[75000]: INFO os_vif [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5')
Nov 06 23:02:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-2897dcd4-f9be-451f-afae-4d3bc30c1e0c req-ea0c98f5-0dc8-4058-a0b5-a331bac5d1c6 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2897dcd4-f9be-451f-afae-4d3bc30c1e0c req-ea0c98f5-0dc8-4058-a0b5-a331bac5d1c6 service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2897dcd4-f9be-451f-afae-4d3bc30c1e0c req-ea0c98f5-0dc8-4058-a0b5-a331bac5d1c6 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-2897dcd4-f9be-451f-afae-4d3bc30c1e0c req-ea0c98f5-0dc8-4058-a0b5-a331bac5d1c6 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-2897dcd4-f9be-451f-afae-4d3bc30c1e0c req-ea0c98f5-0dc8-4058-a0b5-a331bac5d1c6 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:02:54 user nova-compute[75000]: WARNING nova.compute.manager [req-2897dcd4-f9be-451f-afae-4d3bc30c1e0c req-ea0c98f5-0dc8-4058-a0b5-a331bac5d1c6 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state active and task_state reboot_started_hard.
Nov 06 23:02:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:54 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:55 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 23:02:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Instance rebooted successfully.
Nov 06 23:02:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 23:02:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-176c8bfc-9109-4442-b12a-65bad70b65ff req-35c45e9b-f767-4169-9713-33646c2ef5d4 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:02:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-176c8bfc-9109-4442-b12a-65bad70b65ff req-35c45e9b-f767-4169-9713-33646c2ef5d4 service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-176c8bfc-9109-4442-b12a-65bad70b65ff req-35c45e9b-f767-4169-9713-33646c2ef5d4 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-176c8bfc-9109-4442-b12a-65bad70b65ff req-35c45e9b-f767-4169-9713-33646c2ef5d4 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-176c8bfc-9109-4442-b12a-65bad70b65ff req-35c45e9b-f767-4169-9713-33646c2ef5d4 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:02:56 user nova-compute[75000]: WARNING nova.compute.manager [req-176c8bfc-9109-4442-b12a-65bad70b65ff req-35c45e9b-f767-4169-9713-33646c2ef5d4 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state active and task_state reboot_started_hard.
Nov 06 23:02:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-89adb85e-1e9c-4734-b340-95e067b3fe5f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.997s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:57 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:02:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:02:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:02:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:02:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:57 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updating instance_info_cache with network_info: [{"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:02:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:02:57 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:02:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:02:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:02:59 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:03:00 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=24.73137664794922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c68142ba-96c1-4444-94b2-594540013d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d6d43577-d118-4693-8a6a-92438ac00fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:03:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:03:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:03:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:03:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:03:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:03:06 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:03:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:03:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:03:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:03:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:03:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:03:56 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:03:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:03:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:03:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:03:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:03:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:03:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:03:58 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:03:59 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:03:59 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:03:59 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=24.729290008544922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c68142ba-96c1-4444-94b2-594540013d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d6d43577-d118-4693-8a6a-92438ac00fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:03:59 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:04:00 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:04:00 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:04:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:04:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:04:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:04:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:04:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:04:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:04:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:04:01 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating instance_info_cache with network_info: [{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:04:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:04:01 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:04:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:04:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:03 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:04:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-53abcc2f-72d8-4def-807c-b7cf8c195785 req-633c242b-630a-41a5-a003-7cc15deda2c1 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received event network-changed-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:04:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-53abcc2f-72d8-4def-807c-b7cf8c195785 req-633c242b-630a-41a5-a003-7cc15deda2c1 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Refreshing instance network info cache due to event network-changed-91653df9-a068-4608-9b16-b6787fc42db9. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:04:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-53abcc2f-72d8-4def-807c-b7cf8c195785 req-633c242b-630a-41a5-a003-7cc15deda2c1 service nova] Acquiring lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:04:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-53abcc2f-72d8-4def-807c-b7cf8c195785 req-633c242b-630a-41a5-a003-7cc15deda2c1 service nova] Acquired lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:04:05 user nova-compute[75000]: DEBUG nova.network.neutron [req-53abcc2f-72d8-4def-807c-b7cf8c195785 req-633c242b-630a-41a5-a003-7cc15deda2c1 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Refreshing network info cache for port 91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:04:06 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:04:06 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:04:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:04:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-53abcc2f-72d8-4def-807c-b7cf8c195785 req-633c242b-630a-41a5-a003-7cc15deda2c1 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Updated VIF entry in instance network info cache for port 91653df9-a068-4608-9b16-b6787fc42db9. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:04:06 user nova-compute[75000]: DEBUG nova.network.neutron [req-53abcc2f-72d8-4def-807c-b7cf8c195785 req-633c242b-630a-41a5-a003-7cc15deda2c1 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Updating instance_info_cache with network_info: [{"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:04:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-53abcc2f-72d8-4def-807c-b7cf8c195785 req-633c242b-630a-41a5-a003-7cc15deda2c1 service nova] Releasing lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG nova.objects.instance [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'flavor' on Instance uuid d26c36a1-6312-4189-9d51-c1cbf6b6ad82 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:04:07 user nova-compute[75000]: INFO nova.compute.manager [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Attaching volume 3d5ce33f-084b-4a50-947a-0131b63ef4d5 to /dev/vdb
Nov 06 23:04:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG os_brick.utils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d383566-dbd7-49f5-82fd-3fc4f9f5f6d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c5adf3-2695-4f31-b90a-cc4f9e166b90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d300684-7b45-4b44-95c4-1233b2b2c31e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c28e60-be21-4b01-8891-5df09b0aab4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:04:07 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 23:04:07 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0540cb-0c2e-4926-9a13-18b2277d1805]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG os_brick.utils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:04:07 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Updating existing volume attachment record: ea513fd5-e63f-473e-952f-49d130dd9fe5 {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 23:04:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:04:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:19 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:04:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:27 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkSEUmqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:04:29 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:04:29 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:04:29 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72479a83-f63d-4e7a-9b05-5c4b5757a1b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 23:04:29 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[353cf194-afaa-4bfa-8f48-4a5590e74737]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5] added
Nov 06 23:04:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8ca3e9-005b-4ae2-8ebe-2f57711b388e]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[81abb139-b0af-408b-8278-372676a9e875]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkSEUmqo {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkSEUmqo" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5562dec-17d9-43ab-963c-7fded0b703bb]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZkSEUmqo'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[badba00f-0485-44d4-ada8-57f583ce7c86]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38899806-9f68-40c7-924f-9ea1dff6f9f4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:04:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:04:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[74af77f7-3c83-486a-bbb4-e1b7c8a2f170]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5, portal: 172.16.0.220,3260]
Nov 06 23:04:29 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5, portal: 172.16.0.220,3260] successful.
Nov 06 23:04:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc81dbf-0446-4227-90ed-b5db53c1746a]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf56c19f-1edb-4c8e-a0fb-e9f857a812bf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:04:29 user nova-compute[75000]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 (non-flash)
Nov 06 23:04:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:04:29 user nova-compute[75000]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 (non-flash)
Nov 06 23:04:29 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3106e7-9c95-4cb6-b465-6ec71799be7c]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:29 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 23:04:30 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 23:04:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkSEUmqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 23:04:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:04:30 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26130333765353937', 'path': '/dev/sdc'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:04:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130333765353937', 'path': '/dev/sdc'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 23:04:30 user nova-compute[75000]: DEBUG nova.objects.instance [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'flavor' on Instance uuid d26c36a1-6312-4189-9d51-c1cbf6b6ad82 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:04:30 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 23:04:30 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:04:30 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 23:04:30 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:04:30 user nova-compute[75000]:   <serial>3d5ce33f-084b-4a50-947a-0131b63ef4d5</serial>
Nov 06 23:04:30 user nova-compute[75000]: </disk>
Nov 06 23:04:30 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 23:04:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:04:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:04:31 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] No VIF found with MAC fa:16:3e:0c:6d:9e, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 23:04:31 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9821c6a7-49d6-46e1-a500-713bf35a4917 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.680s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:04:32 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:04:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:04:33 user nova-compute[75000]: INFO nova.compute.manager [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Detaching volume 3d5ce33f-084b-4a50-947a-0131b63ef4d5
Nov 06 23:04:33 user nova-compute[75000]: INFO nova.virt.block_device [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Attempting to driver detach volume 3d5ce33f-084b-4a50-947a-0131b63ef4d5 from mountpoint /dev/vdb
Nov 06 23:04:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Attempting to detach device vdb from instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 23:04:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:04:33 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:04:33 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 23:04:33 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:04:33 user nova-compute[75000]:   <serial>3d5ce33f-084b-4a50-947a-0131b63ef4d5</serial>
Nov 06 23:04:33 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 23:04:33 user nova-compute[75000]: </disk>
Nov 06 23:04:33 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:04:33 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Successfully detached device vdb from instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82 from the persistent domain config.
Nov 06 23:04:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 23:04:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:04:33 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:04:33 user nova-compute[75000]:   <source dev="/dev/sdc"/>
Nov 06 23:04:33 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:04:33 user nova-compute[75000]:   <serial>3d5ce33f-084b-4a50-947a-0131b63ef4d5</serial>
Nov 06 23:04:33 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 23:04:33 user nova-compute[75000]: </disk>
Nov 06 23:04:33 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:04:33 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 23:04:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:37 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-87d81311-5509-4a29-9860-cbf2eb14febd req-f75c860f-5cba-4cd3-98ae-fccba24e3e22 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:04:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-87d81311-5509-4a29-9860-cbf2eb14febd req-f75c860f-5cba-4cd3-98ae-fccba24e3e22 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing instance network info cache due to event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:04:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87d81311-5509-4a29-9860-cbf2eb14febd req-f75c860f-5cba-4cd3-98ae-fccba24e3e22 service nova] Acquiring lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:04:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87d81311-5509-4a29-9860-cbf2eb14febd req-f75c860f-5cba-4cd3-98ae-fccba24e3e22 service nova] Acquired lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:04:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-87d81311-5509-4a29-9860-cbf2eb14febd req-f75c860f-5cba-4cd3-98ae-fccba24e3e22 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing network info cache for port a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:04:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-87d81311-5509-4a29-9860-cbf2eb14febd req-f75c860f-5cba-4cd3-98ae-fccba24e3e22 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updated VIF entry in instance network info cache for port a7d95d6d-f5c0-43c1-8be1-bbe2798779ca. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:04:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-87d81311-5509-4a29-9860-cbf2eb14febd req-f75c860f-5cba-4cd3-98ae-fccba24e3e22 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating instance_info_cache with network_info: [{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:04:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-87d81311-5509-4a29-9860-cbf2eb14febd req-f75c860f-5cba-4cd3-98ae-fccba24e3e22 service nova] Releasing lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-a6704d7f-aeea-4496-9430-83ad1af174ee req-eb90caf7-7c00-449f-9672-9ac39b0138b1 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.compute.manager [req-a6704d7f-aeea-4496-9430-83ad1af174ee req-eb90caf7-7c00-449f-9672-9ac39b0138b1 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing instance network info cache due to event network-changed-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a6704d7f-aeea-4496-9430-83ad1af174ee req-eb90caf7-7c00-449f-9672-9ac39b0138b1 service nova] Acquiring lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a6704d7f-aeea-4496-9430-83ad1af174ee req-eb90caf7-7c00-449f-9672-9ac39b0138b1 service nova] Acquired lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-a6704d7f-aeea-4496-9430-83ad1af174ee req-eb90caf7-7c00-449f-9672-9ac39b0138b1 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Refreshing network info cache for port a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:04:41 user nova-compute[75000]: INFO nova.compute.manager [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Detaching volume b5444914-8f15-4d72-9e9d-88b150cfd184
Nov 06 23:04:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:41 user nova-compute[75000]: INFO nova.virt.block_device [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Attempting to driver detach volume b5444914-8f15-4d72-9e9d-88b150cfd184 from mountpoint /dev/vdb
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Attempting to detach device vdb from instance d6d43577-d118-4693-8a6a-92438ac00fc6 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:04:41 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:04:41 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 23:04:41 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:04:41 user nova-compute[75000]:   <serial>b5444914-8f15-4d72-9e9d-88b150cfd184</serial>
Nov 06 23:04:41 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 23:04:41 user nova-compute[75000]: </disk>
Nov 06 23:04:41 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:04:41 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully detached device vdb from instance d6d43577-d118-4693-8a6a-92438ac00fc6 from the persistent domain config.
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6d43577-d118-4693-8a6a-92438ac00fc6 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:04:41 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:04:41 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 23:04:41 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:04:41 user nova-compute[75000]:   <serial>b5444914-8f15-4d72-9e9d-88b150cfd184</serial>
Nov 06 23:04:41 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 23:04:41 user nova-compute[75000]: </disk>
Nov 06 23:04:41 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-a6704d7f-aeea-4496-9430-83ad1af174ee req-eb90caf7-7c00-449f-9672-9ac39b0138b1 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updated VIF entry in instance network info cache for port a7d95d6d-f5c0-43c1-8be1-bbe2798779ca. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.network.neutron [req-a6704d7f-aeea-4496-9430-83ad1af174ee req-eb90caf7-7c00-449f-9672-9ac39b0138b1 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating instance_info_cache with network_info: [{"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-a6704d7f-aeea-4496-9430-83ad1af174ee req-eb90caf7-7c00-449f-9672-9ac39b0138b1 service nova] Releasing lock "refresh_cache-d6d43577-d118-4693-8a6a-92438ac00fc6" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:04:41 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 23:04:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:04:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:04:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:04:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:04:47 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:53 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82 is timed out.
Nov 06 23:04:53 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Successfully detached device vdb from instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82 from the live domain config.
Nov 06 23:04:53 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkSEUmqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:04:53 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:04:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03440c3-cddc-4d4a-8d05-a381cac3d533]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 23:04:53 user nova-compute[75000]: No targets found.
Nov 06 23:04:53 user nova-compute[75000]: iSNS:
Nov 06 23:04:53 user nova-compute[75000]: No targets found.
Nov 06 23:04:53 user nova-compute[75000]: STATIC:
Nov 06 23:04:53 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184
Nov 06 23:04:53 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:04:53 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:04:53 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5
Nov 06 23:04:53 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:04:53 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:04:53 user nova-compute[75000]: FIRMWARE:
Nov 06 23:04:53 user nova-compute[75000]: No targets found.
Nov 06 23:04:53 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 23:04:53 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 23:04:53 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed19edc0-66c3-4779-b4b2-baa2f76db58b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:53 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[127fc4e4-d0dd-4a87-956c-94ad332a1ca7]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:04:54 user nova-compute[75000]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 (non-flash)
Nov 06 23:04:54 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:04:54 user nova-compute[75000]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 (non-flash)
Nov 06 23:04:54 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc5bf1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5'): ({'sdc'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Removing single pathed devices sdc {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e326c-a06d-4cff-ae08-b699c495531f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e78f0-8804-40a2-8954-55493d044646]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Flushing IO for device /dev/sdc {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21540a-b502-4af9-ba9d-1b9977e112f4]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[db572e3f-176e-426e-b505-946912359d94]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] SCSI volumes sdc have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb41889c-3976-42d8-848d-50fabe8c41bd]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7361c1-fc5e-41bc-950b-7d3cd8855940]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5, portal: 172.16.0.220,3260]
Nov 06 23:04:54 user nova-compute[75000]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5, portal: 172.16.0.220,3260] successful.
Nov 06 23:04:54 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ce33f-084b-4a50-947a-0131b63ef4d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00472edc-c78a-4cd3-9c14-286a06d9d1e7]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] <== disconnect_volume: return (294ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:04:54 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 23:04:55 user nova-compute[75000]: DEBUG nova.objects.instance [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'flavor' on Instance uuid d26c36a1-6312-4189-9d51-c1cbf6b6ad82 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:04:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-582457a6-80fa-4d84-bd25-c55cf9d04672 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:04:57 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:04:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:04:59 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:05:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=24.727542877197266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c68142ba-96c1-4444-94b2-594540013d5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d6d43577-d118-4693-8a6a-92438ac00fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6d43577-d118-4693-8a6a-92438ac00fc6 is timed out.
Nov 06 23:05:01 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully detached device vdb from instance d6d43577-d118-4693-8a6a-92438ac00fc6 from the live domain config.
Nov 06 23:05:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iAnWBvzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:05:01 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:05:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[58837f22-1fd1-452a-9557-72c60562499b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 23:05:01 user nova-compute[75000]: No targets found.
Nov 06 23:05:01 user nova-compute[75000]: iSNS:
Nov 06 23:05:01 user nova-compute[75000]: No targets found.
Nov 06 23:05:01 user nova-compute[75000]: STATIC:
Nov 06 23:05:01 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184
Nov 06 23:05:01 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:05:01 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:05:01 user nova-compute[75000]: FIRMWARE:
Nov 06 23:05:01 user nova-compute[75000]: No targets found.
Nov 06 23:05:01 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 23:05:01 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 23:05:01 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[273a37f9-a1b0-41a1-bcdb-24d12bcbcf2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cf4088-384d-4d0f-9205-b9cdc99e3683]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:05:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 (non-flash)
Nov 06 23:05:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79b8f9cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb121859-73f5-42e0-b180-ade5e6eb694f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61ee131-5365-4538-8da8-2fb8303be9cf]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[370c0533-ab67-4e80-b18b-af3656d16c2d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41b7c43-fbaf-4bc8-9bb9-d9201e4902f5]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ecf41e-78dc-471d-b676-7a5a769ef99d]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67fc41e-20b7-451a-9629-bff29c30fb12]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260]
Nov 06 23:05:02 user nova-compute[75000]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184, portal: 172.16.0.220,3260] successful.
Nov 06 23:05:02 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5444914-8f15-4d72-9e9d-88b150cfd184 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6725879a-2ba9-4465-8cab-0f9f5555c109]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] <== disconnect_volume: return (272ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:05:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:05:03 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid c68142ba-96c1-4444-94b2-594540013d5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:05:03 user nova-compute[75000]: DEBUG nova.objects.instance [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'flavor' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:05:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-b2b858c3-a8c4-4caf-b07f-ca1185b22d9c tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.909s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:03 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updating instance_info_cache with network_info: [{"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:05:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:05:03 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:05:05 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:05:07 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:05:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:05:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:05:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:05:12 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:17 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:22 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-03ff774a-729b-4caf-b4a4-5d2a51278ef2 req-238148fe-48f0-4af6-b61c-a4cfd63668fd service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received event network-changed-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-03ff774a-729b-4caf-b4a4-5d2a51278ef2 req-238148fe-48f0-4af6-b61c-a4cfd63668fd service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Refreshing instance network info cache due to event network-changed-91653df9-a068-4608-9b16-b6787fc42db9. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-03ff774a-729b-4caf-b4a4-5d2a51278ef2 req-238148fe-48f0-4af6-b61c-a4cfd63668fd service nova] Acquiring lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-03ff774a-729b-4caf-b4a4-5d2a51278ef2 req-238148fe-48f0-4af6-b61c-a4cfd63668fd service nova] Acquired lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.network.neutron [req-03ff774a-729b-4caf-b4a4-5d2a51278ef2 req-238148fe-48f0-4af6-b61c-a4cfd63668fd service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Refreshing network info cache for port 91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:24 user nova-compute[75000]: INFO nova.compute.manager [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Terminating instance
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.compute.manager [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.network.neutron [req-03ff774a-729b-4caf-b4a4-5d2a51278ef2 req-238148fe-48f0-4af6-b61c-a4cfd63668fd service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Updated VIF entry in instance network info cache for port 91653df9-a068-4608-9b16-b6787fc42db9. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.network.neutron [req-03ff774a-729b-4caf-b4a4-5d2a51278ef2 req-238148fe-48f0-4af6-b61c-a4cfd63668fd service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Updating instance_info_cache with network_info: [{"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-03ff774a-729b-4caf-b4a4-5d2a51278ef2 req-238148fe-48f0-4af6-b61c-a4cfd63668fd service nova] Releasing lock "refresh_cache-d26c36a1-6312-4189-9d51-c1cbf6b6ad82" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-efd2160e-8881-42bf-8774-5253b27f3045 req-5d379b14-99b6-430b-a915-77ff446982f8 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received event network-vif-unplugged-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-efd2160e-8881-42bf-8774-5253b27f3045 req-5d379b14-99b6-430b-a915-77ff446982f8 service nova] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-efd2160e-8881-42bf-8774-5253b27f3045 req-5d379b14-99b6-430b-a915-77ff446982f8 service nova] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-efd2160e-8881-42bf-8774-5253b27f3045 req-5d379b14-99b6-430b-a915-77ff446982f8 service nova] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-efd2160e-8881-42bf-8774-5253b27f3045 req-5d379b14-99b6-430b-a915-77ff446982f8 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] No waiting events found dispatching network-vif-unplugged-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.compute.manager [req-efd2160e-8881-42bf-8774-5253b27f3045 req-5d379b14-99b6-430b-a915-77ff446982f8 service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received event network-vif-unplugged-91653df9-a068-4608-9b16-b6787fc42db9 for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 23:05:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Instance destroyed successfully.
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.objects.instance [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'resources' on Instance uuid d26c36a1-6312-4189-9d51-c1cbf6b6ad82 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T23:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-223432253',display_name='tempest-TestStampPattern-server-223432253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-223432253',id=51,image_ref='3bd70e9b-66cf-4e24-9eb3-e17b77e08454',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzd1TeUb9xHdATOiIf8dKGlOM1ny1WtLBC3p9frwKccZQb58JULy63qIiBmJZtsToMzop1wWDhsDsoTRzfqJCw9ayr51j7hxcgUkCCpFOabwgcVXQ2bATNmgOxvg5Ndug==',key_name='tempest-TestStampPattern-1915820448',keypairs=<?>,launch_index=0,launched_at=2023-11-06T23:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a78c57cc47f84224a42fb08d00fc8985',ramdisk_id='',reservation_id='r-4uyhmkoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c68142ba-96c1-4444-94b2-594540013d5f',image_min_disk='1',image_min_ram='0',image_owner_id='a78c57cc47f84224a42fb08d00fc8985',image_owner_project_name='tempest-TestStampPattern-1217219102',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1217219102-project-member',image_user_id='10a609466eee4d45b45ed972ab1e93c1',owner_project_name='tempest-TestStampPattern-1217219102',owner_user_name='tempest-TestStampPattern-1217219102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T23:02:21Z,user_data=None,user_id='10a609466eee4d45b45ed972ab1e93c1',uuid=d26c36a1-6312-4189-9d51-c1cbf6b6ad82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converting VIF {"id": "91653df9-a068-4608-9b16-b6787fc42db9", "address": "fa:16:3e:0c:6d:9e", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91653df9-a0", "ovs_interfaceid": "91653df9-a068-4608-9b16-b6787fc42db9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=91653df9-a068-4608-9b16-b6787fc42db9,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91653df9-a0') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG os_vif [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=91653df9-a068-4608-9b16-b6787fc42db9,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91653df9-a0') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91653df9-a0, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69e5fb26-cd56-49f2-aad2-35f5e52df2f1) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:24 user nova-compute[75000]: INFO os_vif [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6d:9e,bridge_name='br-int',has_traffic_filtering=True,id=91653df9-a068-4608-9b16-b6787fc42db9,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91653df9-a0')
Nov 06 23:05:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Deleting instance files /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82_del
Nov 06 23:05:24 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Deletion of /opt/stack/data/nova/instances/d26c36a1-6312-4189-9d51-c1cbf6b6ad82_del complete
Nov 06 23:05:24 user nova-compute[75000]: INFO nova.compute.manager [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 06 23:05:24 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 23:05:24 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 23:05:25 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:05:25 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Took 0.39 seconds to deallocate network for instance.
Nov 06 23:05:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:25 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:05:25 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:05:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:25 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Deleted allocations for instance d26c36a1-6312-4189-9d51-c1cbf6b6ad82
Nov 06 23:05:25 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-240cf263-81de-4545-9054-7985cda4f8a7 tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.645s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-afd96958-c0dd-4e58-beec-733b8b69e7ee req-f8723e1d-736a-406f-b597-eb6bd61d740e service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received event network-vif-deleted-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-02ec6cdd-3de4-439a-9c97-a0f637b0dea6 req-3e26ead1-075c-49e5-916f-7068b4f1aabd service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received event network-vif-plugged-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-02ec6cdd-3de4-439a-9c97-a0f637b0dea6 req-3e26ead1-075c-49e5-916f-7068b4f1aabd service nova] Acquiring lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-02ec6cdd-3de4-439a-9c97-a0f637b0dea6 req-3e26ead1-075c-49e5-916f-7068b4f1aabd service nova] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:26 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-02ec6cdd-3de4-439a-9c97-a0f637b0dea6 req-3e26ead1-075c-49e5-916f-7068b4f1aabd service nova] Lock "d26c36a1-6312-4189-9d51-c1cbf6b6ad82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:26 user nova-compute[75000]: DEBUG nova.compute.manager [req-02ec6cdd-3de4-439a-9c97-a0f637b0dea6 req-3e26ead1-075c-49e5-916f-7068b4f1aabd service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] No waiting events found dispatching network-vif-plugged-91653df9-a068-4608-9b16-b6787fc42db9 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:05:26 user nova-compute[75000]: WARNING nova.compute.manager [req-02ec6cdd-3de4-439a-9c97-a0f637b0dea6 req-3e26ead1-075c-49e5-916f-7068b4f1aabd service nova] [instance: d26c36a1-6312-4189-9d51-c1cbf6b6ad82] Received unexpected event network-vif-plugged-91653df9-a068-4608-9b16-b6787fc42db9 for instance with vm_state deleted and task_state None.
Nov 06 23:05:29 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:34 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:42 user nova-compute[75000]: INFO nova.compute.manager [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Terminating instance
Nov 06 23:05:42 user nova-compute[75000]: DEBUG nova.compute.manager [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-0a4033f6-a7fe-4e0f-8f44-ffb085b822f8 req-e992bee0-6a55-4ce7-9b98-73396cfca75b service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-unplugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0a4033f6-a7fe-4e0f-8f44-ffb085b822f8 req-e992bee0-6a55-4ce7-9b98-73396cfca75b service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0a4033f6-a7fe-4e0f-8f44-ffb085b822f8 req-e992bee0-6a55-4ce7-9b98-73396cfca75b service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0a4033f6-a7fe-4e0f-8f44-ffb085b822f8 req-e992bee0-6a55-4ce7-9b98-73396cfca75b service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-0a4033f6-a7fe-4e0f-8f44-ffb085b822f8 req-e992bee0-6a55-4ce7-9b98-73396cfca75b service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-unplugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-0a4033f6-a7fe-4e0f-8f44-ffb085b822f8 req-e992bee0-6a55-4ce7-9b98-73396cfca75b service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-unplugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 23:05:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Instance destroyed successfully.
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.objects.instance [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'resources' on Instance uuid d6d43577-d118-4693-8a6a-92438ac00fc6 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-149096020',display_name='tempest-TestMinimumBasicScenario-server-149096020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-149096020',id=50,image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf8Qv+8D2Gx514+yZ6HpuGxtKZuGQ+2lFjKMN0XpMLqz1WbCbwaE9mBBqm6fCPckDfpijGPupQZaYw1GGnNgZHiEmTXOLz0I5k7ftQfIH79R7DjaX+O29XUxrgz0ny7Aw==',key_name='tempest-TestMinimumBasicScenario-479337453',keypairs=<?>,launch_index=0,launched_at=2023-11-06T23:00:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e5d66722e747c98e9b1eb57915287d',ramdisk_id='',reservation_id='r-24d7l7ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6d9a543f-0771-4d1e-8df7-834ea5778fb9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1418906334',owner_user_name='tempest-TestMinimumBasicScenario-1418906334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T23:02:56Z,user_data=None,user_id='1da9d6a0e8f14304b3d15b89d3d19ebc',uuid=d6d43577-d118-4693-8a6a-92438ac00fc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converting VIF {"id": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "address": "fa:16:3e:c1:ad:45", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d95d6d-f5", "ovs_interfaceid": "a7d95d6d-f5c0-43c1-8be1-bbe2798779ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG os_vif [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7d95d6d-f5, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4300225-496e-4f94-b02c-91dae0e9fabe) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:43 user nova-compute[75000]: INFO os_vif [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:ad:45,bridge_name='br-int',has_traffic_filtering=True,id=a7d95d6d-f5c0-43c1-8be1-bbe2798779ca,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d95d6d-f5')
Nov 06 23:05:43 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Deleting instance files /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6_del
Nov 06 23:05:43 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Deletion of /opt/stack/data/nova/instances/d6d43577-d118-4693-8a6a-92438ac00fc6_del complete
Nov 06 23:05:43 user nova-compute[75000]: INFO nova.compute.manager [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 06 23:05:43 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:05:43 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Took 0.42 seconds to deallocate network for instance.
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.compute.manager [req-84c4575c-4c83-4309-bda1-be359e126466 req-bf556bd5-97d8-42ff-83c3-161519bbbd96 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-deleted-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:05:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:43 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Deleted allocations for instance d6d43577-d118-4693-8a6a-92438ac00fc6
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-5f86ebe5-8977-4f46-9ed6-bc04bd1cbf7f tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.679s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:05:44 user nova-compute[75000]: WARNING nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state deleted and task_state None.
Nov 06 23:05:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:05:44 user nova-compute[75000]: WARNING nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state deleted and task_state None.
Nov 06 23:05:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:05:44 user nova-compute[75000]: WARNING nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state deleted and task_state None.
Nov 06 23:05:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Acquiring lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] Lock "d6d43577-d118-4693-8a6a-92438ac00fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:05:44 user nova-compute[75000]: DEBUG nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] No waiting events found dispatching network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:05:44 user nova-compute[75000]: WARNING nova.compute.manager [req-0e4a6ca8-f99b-4026-b1ea-35b579cccb3c req-04ef7dc6-4eed-495d-94f1-1689a38bb867 service nova] [instance: d6d43577-d118-4693-8a6a-92438ac00fc6] Received unexpected event network-vif-plugged-a7d95d6d-f5c0-43c1-8be1-bbe2798779ca for instance with vm_state deleted and task_state None.
Nov 06 23:05:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:05:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:58 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:05:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:05:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:05:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:05:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:05:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:06:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:06:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=24.755821228027344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:06:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance c68142ba-96c1-4444-94b2-594540013d5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:06:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:06:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:06:01 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:06:01 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:06:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:06:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:02 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:06:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:06:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 23:06:02 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:06:03 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:06 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:06:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:06:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:09 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:06:09 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:06:09 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:06:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:06:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:06:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:06:13 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:18 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:19 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:06:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:06:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:06:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:06:23 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:06:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:06:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:06:28 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:33 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:36 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:36 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Starting instance... {{(pid=75000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 23:06:37 user nova-compute[75000]: INFO nova.compute.claims [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Claim successful on node user
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Start building networks asynchronously for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Allocating IP information in the background. {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] allocate_for_instance() {{(pid=75000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 23:06:37 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Start building block device mappings for instance. {{(pid=75000) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Start spawning the instance on the hypervisor. {{(pid=75000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Creating instance directory {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 23:06:37 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Creating image(s)
Nov 06 23:06:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "/opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "/opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "e5894c484e39a1e252ec8499b7f76830964b6dae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "e5894c484e39a1e252ec8499b7f76830964b6dae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:37 user nova-compute[75000]: DEBUG nova.policy [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1da9d6a0e8f14304b3d15b89d3d19ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e5d66722e747c98e9b1eb57915287d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75000) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae.part --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-76e94e5c-45af-482a-8e14-72f272099140 req-916aabae-59ab-4eb2-bfb4-348d9e53fed7 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received event network-changed-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.compute.manager [req-76e94e5c-45af-482a-8e14-72f272099140 req-916aabae-59ab-4eb2-bfb4-348d9e53fed7 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Refreshing instance network info cache due to event network-changed-81bbdf8f-db63-4132-aec4-b015c5228f86. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-76e94e5c-45af-482a-8e14-72f272099140 req-916aabae-59ab-4eb2-bfb4-348d9e53fed7 service nova] Acquiring lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-76e94e5c-45af-482a-8e14-72f272099140 req-916aabae-59ab-4eb2-bfb4-348d9e53fed7 service nova] Acquired lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.network.neutron [req-76e94e5c-45af-482a-8e14-72f272099140 req-916aabae-59ab-4eb2-bfb4-348d9e53fed7 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Refreshing network info cache for port 81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:38 user nova-compute[75000]: INFO nova.compute.manager [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Terminating instance
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.compute.manager [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.virt.images [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] ddc65114-90d6-462b-9bd9-b55487c264e3 was qcow2, converting to raw {{(pid=75000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.privsep.utils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae.part /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae.converted {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae.part /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae.converted" returned: 0 in 0.371s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae.converted --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.network.neutron [req-76e94e5c-45af-482a-8e14-72f272099140 req-916aabae-59ab-4eb2-bfb4-348d9e53fed7 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updated VIF entry in instance network info cache for port 81bbdf8f-db63-4132-aec4-b015c5228f86. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.network.neutron [req-76e94e5c-45af-482a-8e14-72f272099140 req-916aabae-59ab-4eb2-bfb4-348d9e53fed7 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updating instance_info_cache with network_info: [{"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-76e94e5c-45af-482a-8e14-72f272099140 req-916aabae-59ab-4eb2-bfb4-348d9e53fed7 service nova] Releasing lock "refresh_cache-c68142ba-96c1-4444-94b2-594540013d5f" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "e5894c484e39a1e252ec8499b7f76830964b6dae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.225s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Instance destroyed successfully.
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.objects.instance [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lazy-loading 'resources' on Instance uuid c68142ba-96c1-4444-94b2-594540013d5f {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T22:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1513436224',display_name='tempest-TestStampPattern-server-1513436224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1513436224',id=49,image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzd1TeUb9xHdATOiIf8dKGlOM1ny1WtLBC3p9frwKccZQb58JULy63qIiBmJZtsToMzop1wWDhsDsoTRzfqJCw9ayr51j7hxcgUkCCpFOabwgcVXQ2bATNmgOxvg5Ndug==',key_name='tempest-TestStampPattern-1915820448',keypairs=<?>,launch_index=0,launched_at=2023-11-06T22:58:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a78c57cc47f84224a42fb08d00fc8985',ramdisk_id='',reservation_id='r-tl48fyxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cf3cd688-ea7b-402f-a42c-d141d8f6e4e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1217219102',owner_user_name='tempest-TestStampPattern-1217219102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T23:02:12Z,user_data=None,user_id='10a609466eee4d45b45ed972ab1e93c1',uuid=c68142ba-96c1-4444-94b2-594540013d5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converting VIF {"id": "81bbdf8f-db63-4132-aec4-b015c5228f86", "address": "fa:16:3e:82:f7:55", "network": {"id": "a5678fc0-9c75-4660-b72b-c94efcc27e29", "bridge": "br-int", "label": "tempest-TestStampPattern-228980796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a78c57cc47f84224a42fb08d00fc8985", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bbdf8f-db", "ovs_interfaceid": "81bbdf8f-db63-4132-aec4-b015c5228f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:f7:55,bridge_name='br-int',has_traffic_filtering=True,id=81bbdf8f-db63-4132-aec4-b015c5228f86,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bbdf8f-db') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG os_vif [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:f7:55,bridge_name='br-int',has_traffic_filtering=True,id=81bbdf8f-db63-4132-aec4-b015c5228f86,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bbdf8f-db') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81bbdf8f-db, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc074bd7-4357-4a45-aee3-0b4b8d454d54) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:38 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:38 user nova-compute[75000]: INFO os_vif [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:f7:55,bridge_name='br-int',has_traffic_filtering=True,id=81bbdf8f-db63-4132-aec4-b015c5228f86,network=Network(a5678fc0-9c75-4660-b72b-c94efcc27e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bbdf8f-db')
Nov 06 23:06:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Deleting instance files /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f_del
Nov 06 23:06:38 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Deletion of /opt/stack/data/nova/instances/c68142ba-96c1-4444-94b2-594540013d5f_del complete
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "e5894c484e39a1e252ec8499b7f76830964b6dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "e5894c484e39a1e252ec8499b7f76830964b6dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:39 user nova-compute[75000]: INFO nova.compute.manager [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c68142ba-96c1-4444-94b2-594540013d5f] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Successfully created port: 31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae --force-share --output=json" returned: 0 in 0.194s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae,backing_fmt=raw /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk 1073741824 {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae,backing_fmt=raw /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk 1073741824" returned: 0 in 0.051s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "e5894c484e39a1e252ec8499b7f76830964b6dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5894c484e39a1e252ec8499b7f76830964b6dae --force-share --output=json" returned: 0 in 0.173s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk. size=1073741824 {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:06:39 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Took 0.51 seconds to deallocate network for instance.
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.compute.manager [req-04f9ae0b-1ed4-41cb-b4b7-8f7a5c4b5a26 req-f4c5fc57-608e-4f9e-ab5f-fe2b3fe86cc2 service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received event network-vif-deleted-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.virt.disk.api [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Cannot resize image /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk to a smaller size. {{(pid=75000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Created local disks {{(pid=75000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Ensure instance console log exists: /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/console.log {{(pid=75000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Successfully updated port: 31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 23:06:39 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Deleted allocations for instance c68142ba-96c1-4444-94b2-594540013d5f
Nov 06 23:06:39 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Instance cache missing network info. {{(pid=75000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 23:06:39 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-a47933d5-4d0c-47b0-bcc3-a4aad410e97b tempest-TestStampPattern-1217219102 tempest-TestStampPattern-1217219102-project-member] Lock "c68142ba-96c1-4444-94b2-594540013d5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.723s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.network.neutron [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received event network-vif-unplugged-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] No waiting events found dispatching network-vif-unplugged-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:06:40 user nova-compute[75000]: WARNING nova.compute.manager [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received unexpected event network-vif-unplugged-81bbdf8f-db63-4132-aec4-b015c5228f86 for instance with vm_state deleted and task_state None.
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received event network-vif-plugged-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] Acquiring lock "c68142ba-96c1-4444-94b2-594540013d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] Lock "c68142ba-96c1-4444-94b2-594540013d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] No waiting events found dispatching network-vif-plugged-81bbdf8f-db63-4132-aec4-b015c5228f86 {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:06:40 user nova-compute[75000]: WARNING nova.compute.manager [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: c68142ba-96c1-4444-94b2-594540013d5f] Received unexpected event network-vif-plugged-81bbdf8f-db63-4132-aec4-b015c5228f86 for instance with vm_state deleted and task_state None.
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.compute.manager [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing instance network info cache due to event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Instance network_info: |[{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Start _get_guest_xml network_info=[{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T23:06:34Z,direct_url=<?>,disk_format='qcow2',id=ddc65114-90d6-462b-9bd9-b55487c264e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1767849131',owner='87e5d66722e747c98e9b1eb57915287d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T23:06:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'size': 0, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'ddc65114-90d6-462b-9bd9-b55487c264e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 23:06:40 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:06:40 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CPU controller missing on host. {{(pid=75000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.host [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CPU controller found on host. {{(pid=75000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T22:21:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T23:06:34Z,direct_url=<?>,disk_format='qcow2',id=ddc65114-90d6-462b-9bd9-b55487c264e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1767849131',owner='87e5d66722e747c98e9b1eb57915287d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T23:06:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Flavor limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Image limits 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Flavor pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Image pref 0:0:0 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Got 1 possible topologies {{(pid=75000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.hardware [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T23:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-146771827',display_name='tempest-TestMinimumBasicScenario-server-146771827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-146771827',id=52,image_ref='ddc65114-90d6-462b-9bd9-b55487c264e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIpzFtcw5ML2RcO9tFxaE3KgyrYoqsJu4Kkfkg5KXTsv5v0ozW0Vg2PyHfzgN75W8TAwi8EgKgPno/Q5GjgHfuaYpAnzbwUhi5HCrMmAcOTub5csBM3D4S+44FV/WzDgQ==',key_name='tempest-TestMinimumBasicScenario-1872233036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e5d66722e747c98e9b1eb57915287d',ramdisk_id='',reservation_id='r-pd7qu03z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ddc65114-90d6-462b-9bd9-b55487c264e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1418906334',owner_user_name='tempest-TestMinimumBasicScenario-1418906334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T23:06:38Z,user_data=None,user_id='1da9d6a0e8f14304b3d15b89d3d19ebc',uuid=0c4122f4-4f9c-4a95-9230-5f5224112a26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converting VIF {"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1c:59,bridge_name='br-int',has_traffic_filtering=True,id=31f20b2e-4511-47d2-be44-a5613d90d32c,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f20b2e-45') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.objects.instance [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] End _get_guest_xml xml=<domain type="kvm">
Nov 06 23:06:40 user nova-compute[75000]:   <uuid>0c4122f4-4f9c-4a95-9230-5f5224112a26</uuid>
Nov 06 23:06:40 user nova-compute[75000]:   <name>instance-00000034</name>
Nov 06 23:06:40 user nova-compute[75000]:   <memory>524288</memory>
Nov 06 23:06:40 user nova-compute[75000]:   <vcpu>1</vcpu>
Nov 06 23:06:40 user nova-compute[75000]:   <metadata>
Nov 06 23:06:40 user nova-compute[75000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 23:06:40 user nova-compute[75000]:       <nova:package version="0.0.0"/>
Nov 06 23:06:40 user nova-compute[75000]:       <nova:name>tempest-TestMinimumBasicScenario-server-146771827</nova:name>
Nov 06 23:06:40 user nova-compute[75000]:       <nova:creationTime>2023-11-06 23:06:40</nova:creationTime>
Nov 06 23:06:40 user nova-compute[75000]:       <nova:flavor name="m1.tiny">
Nov 06 23:06:40 user nova-compute[75000]:         <nova:memory>512</nova:memory>
Nov 06 23:06:40 user nova-compute[75000]:         <nova:disk>1</nova:disk>
Nov 06 23:06:40 user nova-compute[75000]:         <nova:swap>0</nova:swap>
Nov 06 23:06:40 user nova-compute[75000]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 23:06:40 user nova-compute[75000]:         <nova:vcpus>1</nova:vcpus>
Nov 06 23:06:40 user nova-compute[75000]:       </nova:flavor>
Nov 06 23:06:40 user nova-compute[75000]:       <nova:owner>
Nov 06 23:06:40 user nova-compute[75000]:         <nova:user uuid="1da9d6a0e8f14304b3d15b89d3d19ebc">tempest-TestMinimumBasicScenario-1418906334-project-member</nova:user>
Nov 06 23:06:40 user nova-compute[75000]:         <nova:project uuid="87e5d66722e747c98e9b1eb57915287d">tempest-TestMinimumBasicScenario-1418906334</nova:project>
Nov 06 23:06:40 user nova-compute[75000]:       </nova:owner>
Nov 06 23:06:40 user nova-compute[75000]:       <nova:root type="image" uuid="ddc65114-90d6-462b-9bd9-b55487c264e3"/>
Nov 06 23:06:40 user nova-compute[75000]:       <nova:ports>
Nov 06 23:06:40 user nova-compute[75000]:         <nova:port uuid="31f20b2e-4511-47d2-be44-a5613d90d32c">
Nov 06 23:06:40 user nova-compute[75000]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 23:06:40 user nova-compute[75000]:         </nova:port>
Nov 06 23:06:40 user nova-compute[75000]:       </nova:ports>
Nov 06 23:06:40 user nova-compute[75000]:     </nova:instance>
Nov 06 23:06:40 user nova-compute[75000]:   </metadata>
Nov 06 23:06:40 user nova-compute[75000]:   <sysinfo type="smbios">
Nov 06 23:06:40 user nova-compute[75000]:     <system>
Nov 06 23:06:40 user nova-compute[75000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 23:06:40 user nova-compute[75000]:       <entry name="product">OpenStack Nova</entry>
Nov 06 23:06:40 user nova-compute[75000]:       <entry name="version">0.0.0</entry>
Nov 06 23:06:40 user nova-compute[75000]:       <entry name="serial">0c4122f4-4f9c-4a95-9230-5f5224112a26</entry>
Nov 06 23:06:40 user nova-compute[75000]:       <entry name="uuid">0c4122f4-4f9c-4a95-9230-5f5224112a26</entry>
Nov 06 23:06:40 user nova-compute[75000]:       <entry name="family">Virtual Machine</entry>
Nov 06 23:06:40 user nova-compute[75000]:     </system>
Nov 06 23:06:40 user nova-compute[75000]:   </sysinfo>
Nov 06 23:06:40 user nova-compute[75000]:   <os>
Nov 06 23:06:40 user nova-compute[75000]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 23:06:40 user nova-compute[75000]:     <boot dev="hd"/>
Nov 06 23:06:40 user nova-compute[75000]:     <smbios mode="sysinfo"/>
Nov 06 23:06:40 user nova-compute[75000]:   </os>
Nov 06 23:06:40 user nova-compute[75000]:   <features>
Nov 06 23:06:40 user nova-compute[75000]:     <acpi/>
Nov 06 23:06:40 user nova-compute[75000]:     <apic/>
Nov 06 23:06:40 user nova-compute[75000]:     <vmcoreinfo/>
Nov 06 23:06:40 user nova-compute[75000]:   </features>
Nov 06 23:06:40 user nova-compute[75000]:   <clock offset="utc">
Nov 06 23:06:40 user nova-compute[75000]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 23:06:40 user nova-compute[75000]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 23:06:40 user nova-compute[75000]:     <timer name="hpet" present="no"/>
Nov 06 23:06:40 user nova-compute[75000]:   </clock>
Nov 06 23:06:40 user nova-compute[75000]:   <cpu mode="custom" match="exact">
Nov 06 23:06:40 user nova-compute[75000]:     <model>Nehalem</model>
Nov 06 23:06:40 user nova-compute[75000]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 23:06:40 user nova-compute[75000]:   </cpu>
Nov 06 23:06:40 user nova-compute[75000]:   <devices>
Nov 06 23:06:40 user nova-compute[75000]:     <disk type="file" device="disk">
Nov 06 23:06:40 user nova-compute[75000]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 23:06:40 user nova-compute[75000]:       <source file="/opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk"/>
Nov 06 23:06:40 user nova-compute[75000]:       <target dev="vda" bus="virtio"/>
Nov 06 23:06:40 user nova-compute[75000]:     </disk>
Nov 06 23:06:40 user nova-compute[75000]:     <interface type="ethernet">
Nov 06 23:06:40 user nova-compute[75000]:       <mac address="fa:16:3e:8c:1c:59"/>
Nov 06 23:06:40 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 23:06:40 user nova-compute[75000]:       <mtu size="1442"/>
Nov 06 23:06:40 user nova-compute[75000]:       <target dev="tap31f20b2e-45"/>
Nov 06 23:06:40 user nova-compute[75000]:     </interface>
Nov 06 23:06:40 user nova-compute[75000]:     <serial type="pty">
Nov 06 23:06:40 user nova-compute[75000]:       <log file="/opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/console.log" append="off"/>
Nov 06 23:06:40 user nova-compute[75000]:     </serial>
Nov 06 23:06:40 user nova-compute[75000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 23:06:40 user nova-compute[75000]:     <video>
Nov 06 23:06:40 user nova-compute[75000]:       <model type="virtio"/>
Nov 06 23:06:40 user nova-compute[75000]:     </video>
Nov 06 23:06:40 user nova-compute[75000]:     <rng model="virtio">
Nov 06 23:06:40 user nova-compute[75000]:       <backend model="random">/dev/urandom</backend>
Nov 06 23:06:40 user nova-compute[75000]:     </rng>
Nov 06 23:06:40 user nova-compute[75000]:     <controller type="usb" index="0" model="none"/>
Nov 06 23:06:40 user nova-compute[75000]:     <memballoon model="virtio">
Nov 06 23:06:40 user nova-compute[75000]:       <stats period="10"/>
Nov 06 23:06:40 user nova-compute[75000]:     </memballoon>
Nov 06 23:06:40 user nova-compute[75000]:   </devices>
Nov 06 23:06:40 user nova-compute[75000]: </domain>
Nov 06 23:06:40 user nova-compute[75000]:  {{(pid=75000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T23:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-146771827',display_name='tempest-TestMinimumBasicScenario-server-146771827',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-146771827',id=52,image_ref='ddc65114-90d6-462b-9bd9-b55487c264e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIpzFtcw5ML2RcO9tFxaE3KgyrYoqsJu4Kkfkg5KXTsv5v0ozW0Vg2PyHfzgN75W8TAwi8EgKgPno/Q5GjgHfuaYpAnzbwUhi5HCrMmAcOTub5csBM3D4S+44FV/WzDgQ==',key_name='tempest-TestMinimumBasicScenario-1872233036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e5d66722e747c98e9b1eb57915287d',ramdisk_id='',reservation_id='r-pd7qu03z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ddc65114-90d6-462b-9bd9-b55487c264e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1418906334',owner_user_name='tempest-TestMinimumBasicScenario-1418906334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T23:06:38Z,user_data=None,user_id='1da9d6a0e8f14304b3d15b89d3d19ebc',uuid=0c4122f4-4f9c-4a95-9230-5f5224112a26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converting VIF {"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1c:59,bridge_name='br-int',has_traffic_filtering=True,id=31f20b2e-4511-47d2-be44-a5613d90d32c,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f20b2e-45') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG os_vif [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1c:59,bridge_name='br-int',has_traffic_filtering=True,id=31f20b2e-4511-47d2-be44-a5613d90d32c,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f20b2e-45') {{(pid=75000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5476b56e-4ce2-56dd-9eab-d2973e366ae1', '_type': 'linux-noop'}}, row=False) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31f20b2e-45, may_exist=True, interface_attrs={}) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31f20b2e-45, col_values=(('qos', UUID('ccfc9692-86f2-45b2-8654-577777ec4da8')),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31f20b2e-45, col_values=(('external_ids', {'iface-id': '31f20b2e-4511-47d2-be44-a5613d90d32c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:1c:59', 'vm-uuid': '0c4122f4-4f9c-4a95-9230-5f5224112a26'}),), if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:40 user nova-compute[75000]: INFO os_vif [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1c:59,bridge_name='br-int',has_traffic_filtering=True,id=31f20b2e-4511-47d2-be44-a5613d90d32c,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f20b2e-45')
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No VIF found with MAC fa:16:3e:8c:1c:59, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated VIF entry in instance network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG nova.network.neutron [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:06:40 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ffde1de5-4008-4e88-b0ef-871b45efa7f9 req-ea522021-e9ca-4da1-b8da-052f72fda8cb service nova] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:06:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] No waiting events found dispatching network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:06:42 user nova-compute[75000]: WARNING nova.compute.manager [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received unexpected event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c for instance with vm_state building and task_state spawning.
Nov 06 23:06:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG nova.compute.manager [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] No waiting events found dispatching network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:06:42 user nova-compute[75000]: WARNING nova.compute.manager [req-3add7565-66b8-4ebd-8775-4415f9569a9b req-83a02649-e49b-4a50-a109-b3e018265789 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received unexpected event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c for instance with vm_state building and task_state spawning.
Nov 06 23:06:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Instance event wait completed in 0 seconds for  {{(pid=75000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Guest created on hypervisor {{(pid=75000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 23:06:43 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Instance spawned successfully.
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Found default for hw_cdrom_bus of ide {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Found default for hw_disk_bus of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Found default for hw_input_bus of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Found default for hw_pointer_model of None {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Found default for hw_video_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Found default for hw_vif_model of virtio {{(pid=75000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 23:06:43 user nova-compute[75000]: INFO nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 06 23:06:43 user nova-compute[75000]: DEBUG nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 23:06:43 user nova-compute[75000]: INFO nova.compute.manager [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Took 6.68 seconds to build instance.
Nov 06 23:06:43 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-dd6fa2e8-320f-4090-b250-6a3acb11c8bd tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.938s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:06:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:06:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:06:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:06:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:06:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:06:59 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:07:00 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:07:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:07:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:07:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=24.832141876220703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:07:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:03 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:03 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:07:04 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:07:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 23:07:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:09 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:10 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:10 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:07:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:16 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:07:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 23:07:16 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 23:07:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:07:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:42 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:07:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:07:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:07:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:07:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:07:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:08:01 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=24.820926666259766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:08:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:08:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:08:05 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:05 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:08:06 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:08:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:10 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:08:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:08:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:08:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:08:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:11 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:08:12 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:08:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:22 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:08:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG nova.objects.instance [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'flavor' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:08:33 user nova-compute[75000]: INFO nova.compute.manager [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Attaching volume 3959d7bf-b178-4d18-a990-2436739d68fe to /dev/vdb
Nov 06 23:08:33 user nova-compute[75000]: DEBUG os_brick.utils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf716d5-3076-4738-9de6-1a08efdc4519]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4e7f1b14423d\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f7ced-3199-46df-a050-509e4c31ca38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a43858-cbaf-4e88-99e7-94079dd507b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652de60-8800-4910-86a0-0f5467c569ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Running cmd (subprocess): nvme version {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] 'nvme version' failed. Not Retrying. {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] nvme not present on system {{(pid=75000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 23:08:33 user nova-compute[75000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 23:08:33 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40803e17-bd06-4cae-9718-931138cf0de4]: (4, '') {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.lightos [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] LIGHTOS: no hostnqn found. {{(pid=75000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG os_brick.utils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4e7f1b14423d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:08:33 user nova-compute[75000]: DEBUG nova.virt.block_device [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating existing volume attachment record: ce01992c-162c-412a-95a2-36fea0b97e7a {{(pid=75000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 23:08:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:08:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Calling os-brick to attach iSCSI Volume {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAoDdjZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:08:55 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:08:55 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:08:55 user nova-compute[75000]: INFO os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f27da00-75f4-4740-9e83-59d92e3aa6c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 23:08:55 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --interface default --op new {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e840d3-93c0-4e8f-8b9e-f0ff28ceb7eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe] added\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe] added
Nov 06 23:08:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ae831f-4671-4348-baf8-9529eee82934]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecf2a44-d7de-4abf-b483-a046b31b4e0f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zAoDdjZe {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zAoDdjZe" returned: 0 in 0.023s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43dcc8-2950-45c0-93e9-4e53e46f5414]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zAoDdjZe'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd84e574-332c-40b5-b207-8fc566ca32c5]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46bd691-773f-433c-86f0-bc1a09cf20d5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 23:08:55 user nova-compute[75000]:  {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 23:08:55 user nova-compute[75000]:  {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:08:55 user nova-compute[75000]: WARNING os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 23:08:55 user nova-compute[75000]: 
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --login {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc2e919-5a0e-4df7-8443-cbf9a1dd7da9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe, portal: 172.16.0.220,3260]
Nov 06 23:08:55 user nova-compute[75000]: Login to [iface: default, target: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe, portal: 172.16.0.220,3260] successful.
Nov 06 23:08:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db23a4-b617-4a86-8943-6a30488ff94b]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d868a2b-010c-4e09-b585-92c679bc1ef0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe (non-flash)
Nov 06 23:08:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe (non-flash)
Nov 06 23:08:55 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Connected to 172.16.0.220:3260 {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1ed02e-6a78-45b3-bdde-b3680ae88bfc]: (4, ('- - 0', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 23:08:55 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAoDdjZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 23:08:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:08:56 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23466643337363533', 'path': '/dev/sdb'} {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:08:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466643337363533', 'path': '/dev/sdb'} {{(pid=75000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 23:08:56 user nova-compute[75000]: DEBUG nova.objects.instance [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'flavor' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:08:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 23:08:56 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:08:56 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 23:08:56 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:08:56 user nova-compute[75000]:   <serial>3959d7bf-b178-4d18-a990-2436739d68fe</serial>
Nov 06 23:08:56 user nova-compute[75000]: </disk>
Nov 06 23:08:56 user nova-compute[75000]:  {{(pid=75000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 23:08:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No BDM found with device name vda, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:08:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 23:08:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] No VIF found with MAC fa:16:3e:8c:1c:59, not building metadata {{(pid=75000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 23:08:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-839031d4-879f-43d2-8989-11c1879e0bc5 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.251s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:08:58 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:08:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-99c551b7-b3f9-47c3-97ea-acc999f90327 req-e2e8962c-7f55-4d66-b85e-9b8dfdaceb69 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:08:59 user nova-compute[75000]: DEBUG nova.compute.manager [req-99c551b7-b3f9-47c3-97ea-acc999f90327 req-e2e8962c-7f55-4d66-b85e-9b8dfdaceb69 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing instance network info cache due to event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:08:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-99c551b7-b3f9-47c3-97ea-acc999f90327 req-e2e8962c-7f55-4d66-b85e-9b8dfdaceb69 service nova] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:08:59 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-99c551b7-b3f9-47c3-97ea-acc999f90327 req-e2e8962c-7f55-4d66-b85e-9b8dfdaceb69 service nova] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:08:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-99c551b7-b3f9-47c3-97ea-acc999f90327 req-e2e8962c-7f55-4d66-b85e-9b8dfdaceb69 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:08:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-99c551b7-b3f9-47c3-97ea-acc999f90327 req-e2e8962c-7f55-4d66-b85e-9b8dfdaceb69 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated VIF entry in instance network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:08:59 user nova-compute[75000]: DEBUG nova.network.neutron [req-99c551b7-b3f9-47c3-97ea-acc999f90327 req-e2e8962c-7f55-4d66-b85e-9b8dfdaceb69 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:09:00 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-99c551b7-b3f9-47c3-97ea-acc999f90327 req-e2e8962c-7f55-4d66-b85e-9b8dfdaceb69 service nova] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:09:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:09:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-c5afdb64-ec66-4acf-8c8b-61ee10ec4f92 req-4ad64fea-373f-4bf6-aa50-e6b296a753d4 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.compute.manager [req-c5afdb64-ec66-4acf-8c8b-61ee10ec4f92 req-4ad64fea-373f-4bf6-aa50-e6b296a753d4 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing instance network info cache due to event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c5afdb64-ec66-4acf-8c8b-61ee10ec4f92 req-4ad64fea-373f-4bf6-aa50-e6b296a753d4 service nova] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c5afdb64-ec66-4acf-8c8b-61ee10ec4f92 req-4ad64fea-373f-4bf6-aa50-e6b296a753d4 service nova] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-c5afdb64-ec66-4acf-8c8b-61ee10ec4f92 req-4ad64fea-373f-4bf6-aa50-e6b296a753d4 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:09:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:09:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.81915283203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:09:02 user nova-compute[75000]: INFO nova.compute.manager [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Rebooting instance
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-c5afdb64-ec66-4acf-8c8b-61ee10ec4f92 req-4ad64fea-373f-4bf6-aa50-e6b296a753d4 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated VIF entry in instance network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.network.neutron [req-c5afdb64-ec66-4acf-8c8b-61ee10ec4f92 req-4ad64fea-373f-4bf6-aa50-e6b296a753d4 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-c5afdb64-ec66-4acf-8c8b-61ee10ec4f92 req-4ad64fea-373f-4bf6-aa50-e6b296a753d4 service nova] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Building network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.network.neutron [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:09:02 user nova-compute[75000]: DEBUG nova.compute.manager [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 23:09:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-fb3fe501-480f-4d40-b349-85cb437a09e9 req-792759c2-2d67-4b6c-bb55-a940b39e0ac3 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-unplugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fb3fe501-480f-4d40-b349-85cb437a09e9 req-792759c2-2d67-4b6c-bb55-a940b39e0ac3 service nova] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fb3fe501-480f-4d40-b349-85cb437a09e9 req-792759c2-2d67-4b6c-bb55-a940b39e0ac3 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-fb3fe501-480f-4d40-b349-85cb437a09e9 req-792759c2-2d67-4b6c-bb55-a940b39e0ac3 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:09:05 user nova-compute[75000]: DEBUG nova.compute.manager [req-fb3fe501-480f-4d40-b349-85cb437a09e9 req-792759c2-2d67-4b6c-bb55-a940b39e0ac3 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] No waiting events found dispatching network-vif-unplugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:09:05 user nova-compute[75000]: WARNING nova.compute.manager [req-fb3fe501-480f-4d40-b349-85cb437a09e9 req-792759c2-2d67-4b6c-bb55-a940b39e0ac3 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received unexpected event network-vif-unplugged-31f20b2e-4511-47d2-be44-a5613d90d32c for instance with vm_state active and task_state reboot_started.
Nov 06 23:09:06 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Instance shutdown successfully.
Nov 06 23:09:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-b0774eeb-4e0e-4705-92a3-1aebb15784fd req-cd46176a-ceb5-47ae-b13f-64c8623fe824 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b0774eeb-4e0e-4705-92a3-1aebb15784fd req-cd46176a-ceb5-47ae-b13f-64c8623fe824 service nova] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b0774eeb-4e0e-4705-92a3-1aebb15784fd req-cd46176a-ceb5-47ae-b13f-64c8623fe824 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-b0774eeb-4e0e-4705-92a3-1aebb15784fd req-cd46176a-ceb5-47ae-b13f-64c8623fe824 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG nova.compute.manager [req-b0774eeb-4e0e-4705-92a3-1aebb15784fd req-cd46176a-ceb5-47ae-b13f-64c8623fe824 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] No waiting events found dispatching network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:09:07 user nova-compute[75000]: WARNING nova.compute.manager [req-b0774eeb-4e0e-4705-92a3-1aebb15784fd req-cd46176a-ceb5-47ae-b13f-64c8623fe824 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received unexpected event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c for instance with vm_state active and task_state reboot_started.
Nov 06 23:09:07 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:09:07 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:09:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:08 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:09 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Instance running successfully.
Nov 06 23:09:09 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Instance soft rebooted successfully.
Nov 06 23:09:09 user nova-compute[75000]: DEBUG nova.compute.manager [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Checking state {{(pid=75000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 23:09:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:09:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:09:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:09:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:09:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] No waiting events found dispatching network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:09:09 user nova-compute[75000]: WARNING nova.compute.manager [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received unexpected event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c for instance with vm_state active and task_state reboot_started.
Nov 06 23:09:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:09:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:09:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:09:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:09:09 user nova-compute[75000]: DEBUG nova.compute.manager [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] No waiting events found dispatching network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:09:09 user nova-compute[75000]: WARNING nova.compute.manager [req-cf2c7cd9-bf76-46f8-aea4-28b65bf511d4 req-09b1ba06-afbb-4ee1-a240-5012a6e3eabe service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received unexpected event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c for instance with vm_state active and task_state reboot_started.
Nov 06 23:09:09 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-912f67f8-1e15-4680-ac47-6e63d3bd5369 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.411s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:09:10 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:09:10 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:09:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:11 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:09:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:09:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:13 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:09:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:09:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:09:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:09:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:10:01 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 23:10:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:10:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:10:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=24.817337036132812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:10:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:10:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:10:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:10:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:10:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:10:02 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:10:02 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:10:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:10:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:10:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:05 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:10:07 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:10:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:10:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:10:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:10:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:10:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:10:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:11 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:12 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:13 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:13 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:10:14 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:10:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:25 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:10:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:10:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:10:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:10:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:10:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:53 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-460cc80f-2e37-4ee3-a84d-09a17c191e9a req-bb42feb7-f59f-47e7-91a2-b6164f1ab8f8 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-460cc80f-2e37-4ee3-a84d-09a17c191e9a req-bb42feb7-f59f-47e7-91a2-b6164f1ab8f8 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing instance network info cache due to event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-460cc80f-2e37-4ee3-a84d-09a17c191e9a req-bb42feb7-f59f-47e7-91a2-b6164f1ab8f8 service nova] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-460cc80f-2e37-4ee3-a84d-09a17c191e9a req-bb42feb7-f59f-47e7-91a2-b6164f1ab8f8 service nova] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-460cc80f-2e37-4ee3-a84d-09a17c191e9a req-bb42feb7-f59f-47e7-91a2-b6164f1ab8f8 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-460cc80f-2e37-4ee3-a84d-09a17c191e9a req-bb42feb7-f59f-47e7-91a2-b6164f1ab8f8 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated VIF entry in instance network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-460cc80f-2e37-4ee3-a84d-09a17c191e9a req-bb42feb7-f59f-47e7-91a2-b6164f1ab8f8 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-460cc80f-2e37-4ee3-a84d-09a17c191e9a req-bb42feb7-f59f-47e7-91a2-b6164f1ab8f8 service nova] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-5a0ce3c6-79d3-47cf-b029-b9702c1b48c0 req-a5ca8db6-6a21-48e0-a0ff-0aa18784ac91 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG nova.compute.manager [req-5a0ce3c6-79d3-47cf-b029-b9702c1b48c0 req-a5ca8db6-6a21-48e0-a0ff-0aa18784ac91 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing instance network info cache due to event network-changed-31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5a0ce3c6-79d3-47cf-b029-b9702c1b48c0 req-a5ca8db6-6a21-48e0-a0ff-0aa18784ac91 service nova] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5a0ce3c6-79d3-47cf-b029-b9702c1b48c0 req-a5ca8db6-6a21-48e0-a0ff-0aa18784ac91 service nova] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG nova.network.neutron [req-5a0ce3c6-79d3-47cf-b029-b9702c1b48c0 req-a5ca8db6-6a21-48e0-a0ff-0aa18784ac91 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Refreshing network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:10:54 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:10:55 user nova-compute[75000]: INFO nova.compute.manager [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Detaching volume 3959d7bf-b178-4d18-a990-2436739d68fe
Nov 06 23:10:55 user nova-compute[75000]: INFO nova.virt.block_device [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Attempting to driver detach volume 3959d7bf-b178-4d18-a990-2436739d68fe from mountpoint /dev/vdb
Nov 06 23:10:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Attempting to detach device vdb from instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 from the persistent domain config. {{(pid=75000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 23:10:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:10:55 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:10:55 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 23:10:55 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:10:55 user nova-compute[75000]:   <serial>3959d7bf-b178-4d18-a990-2436739d68fe</serial>
Nov 06 23:10:55 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 23:10:55 user nova-compute[75000]: </disk>
Nov 06 23:10:55 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:10:55 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully detached device vdb from instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 from the persistent domain config.
Nov 06 23:10:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 from the live domain config. {{(pid=75000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 23:10:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.guest [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 23:10:55 user nova-compute[75000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 23:10:55 user nova-compute[75000]:   <source dev="/dev/sdb"/>
Nov 06 23:10:55 user nova-compute[75000]:   <target dev="vdb" bus="virtio"/>
Nov 06 23:10:55 user nova-compute[75000]:   <serial>3959d7bf-b178-4d18-a990-2436739d68fe</serial>
Nov 06 23:10:55 user nova-compute[75000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 23:10:55 user nova-compute[75000]: </disk>
Nov 06 23:10:55 user nova-compute[75000]:  {{(pid=75000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 23:10:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:10:55 user nova-compute[75000]: DEBUG nova.virt.libvirt.driver [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 23:10:55 user nova-compute[75000]: DEBUG nova.network.neutron [req-5a0ce3c6-79d3-47cf-b029-b9702c1b48c0 req-a5ca8db6-6a21-48e0-a0ff-0aa18784ac91 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated VIF entry in instance network info cache for port 31f20b2e-4511-47d2-be44-a5613d90d32c. {{(pid=75000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 23:10:55 user nova-compute[75000]: DEBUG nova.network.neutron [req-5a0ce3c6-79d3-47cf-b029-b9702c1b48c0 req-a5ca8db6-6a21-48e0-a0ff-0aa18784ac91 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:10:55 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-5a0ce3c6-79d3-47cf-b029-b9702c1b48c0 req-a5ca8db6-6a21-48e0-a0ff-0aa18784ac91 service nova] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:10:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:00 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:11:02 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:11:02 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=24.81659698486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:11:02 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:11:03 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 23:11:03 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:11:03 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:11:03 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:11:03 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:11:03 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:11:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:11:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:11:05 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:11:05 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:07 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquired lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Forcefully refreshing network info cache for instance {{(pid=75000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG nova.objects.instance [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lazy-loading 'info_cache' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG nova.network.neutron [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [{"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Releasing lock "refresh_cache-0c4122f4-4f9c-4a95-9230-5f5224112a26" {{(pid=75000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 23:11:08 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updated the network info_cache for instance {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 23:11:10 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:11 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:11:12 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:11:14 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:11:14 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:11:15 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 is timed out.
Nov 06 23:11:15 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully detached device vdb from instance 0c4122f4-4f9c-4a95-9230-5f5224112a26 from the live domain config.
Nov 06 23:11:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] calling os-brick to detach iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f79dc72a6e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAoDdjZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 23:11:15 user nova-compute[75000]: WARNING os_brick.initiator.connectors.base [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[703129ed-75e5-4b17-9a21-ea4f455b467d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 23:11:15 user nova-compute[75000]: No targets found.
Nov 06 23:11:15 user nova-compute[75000]: iSNS:
Nov 06 23:11:15 user nova-compute[75000]: No targets found.
Nov 06 23:11:15 user nova-compute[75000]: STATIC:
Nov 06 23:11:15 user nova-compute[75000]: Target: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe
Nov 06 23:11:15 user nova-compute[75000]:         Portal: 172.16.0.220:3260,-1
Nov 06 23:11:15 user nova-compute[75000]:                 Iface Name: default
Nov 06 23:11:15 user nova-compute[75000]: FIRMWARE:
Nov 06 23:11:15 user nova-compute[75000]: No targets found.
Nov 06 23:11:15 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 23:11:15 user nova-compute[75000]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 23:11:15 user nova-compute[75000]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75000) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe', 0)] {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b59a200-3014-47cb-8cd2-1ed9af89d841]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf0677-36a8-4d06-b6e5-41a9ca5511b5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe (non-flash)\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe (non-flash)
Nov 06 23:11:15 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe (non-flash)
Nov 06 23:11:15 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79dc295240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe'): ({'sdb'}, set())}) {{(pid=75000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Removing single pathed devices sdb {{(pid=75000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4c50f-ed11-4b39-bdf9-e354cc517c46]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e443d5e-0ef2-42b9-b33b-e286bc1b6aa4]: (4, ('ok\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Flushing IO for device /dev/sdb {{(pid=75000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f9ac64-8aa6-4431-9045-ce5220e54b03]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1176b7-93ae-44de-8116-559e4d0d7121]: (4, ('1', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.linuxscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] SCSI volumes sdb have been removed. {{(pid=75000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe')] {{(pid=75000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8364a47c-70fc-47c0-8092-3735ade808b1]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --logout {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb953d8a-02b5-4f52-af78-4032cc59cab4]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe, portal: 172.16.0.220,3260]
Nov 06 23:11:15 user nova-compute[75000]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe, portal: 172.16.0.220,3260] successful.
Nov 06 23:11:15 user nova-compute[75000]:  stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op delete {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3959d7bf-b178-4d18-a990-2436739d68fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86571) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6464ab5c-66cf-4962-99bd-efc631a9377f]: (4, ('', '')) {{(pid=86571) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.base [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] <== disconnect_volume: return (281ms) None {{(pid=75000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 23:11:15 user nova-compute[75000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Disconnected iSCSI Volume {{(pid=75000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 23:11:16 user nova-compute[75000]: DEBUG nova.objects.instance [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'flavor' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:11:16 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-9678293b-8b2e-423a-8b7b-55a131071c67 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.805s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:11:20 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:25 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:30 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:35 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:40 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:11:45 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:11:50 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:55 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:11:56 user nova-compute[75000]: INFO nova.compute.manager [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Terminating instance
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.compute.manager [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Start destroying the instance on the hypervisor. {{(pid=75000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-4f89b8cc-36a2-4717-9c9a-ff1a41d3015f req-6c6999cb-78ab-48c8-a0b1-6798569ae7ac service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-unplugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4f89b8cc-36a2-4717-9c9a-ff1a41d3015f req-6c6999cb-78ab-48c8-a0b1-6798569ae7ac service nova] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4f89b8cc-36a2-4717-9c9a-ff1a41d3015f req-6c6999cb-78ab-48c8-a0b1-6798569ae7ac service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-4f89b8cc-36a2-4717-9c9a-ff1a41d3015f req-6c6999cb-78ab-48c8-a0b1-6798569ae7ac service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-4f89b8cc-36a2-4717-9c9a-ff1a41d3015f req-6c6999cb-78ab-48c8-a0b1-6798569ae7ac service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] No waiting events found dispatching network-vif-unplugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.compute.manager [req-4f89b8cc-36a2-4717-9c9a-ff1a41d3015f req-6c6999cb-78ab-48c8-a0b1-6798569ae7ac service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-unplugged-31f20b2e-4511-47d2-be44-a5613d90d32c for instance with task_state deleting. {{(pid=75000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [-] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Instance destroyed successfully.
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.objects.instance [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lazy-loading 'resources' on Instance uuid 0c4122f4-4f9c-4a95-9230-5f5224112a26 {{(pid=75000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.virt.libvirt.vif [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T23:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-146771827',display_name='tempest-TestMinimumBasicScenario-server-146771827',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-146771827',id=52,image_ref='ddc65114-90d6-462b-9bd9-b55487c264e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIpzFtcw5ML2RcO9tFxaE3KgyrYoqsJu4Kkfkg5KXTsv5v0ozW0Vg2PyHfzgN75W8TAwi8EgKgPno/Q5GjgHfuaYpAnzbwUhi5HCrMmAcOTub5csBM3D4S+44FV/WzDgQ==',key_name='tempest-TestMinimumBasicScenario-1872233036',keypairs=<?>,launch_index=0,launched_at=2023-11-06T23:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e5d66722e747c98e9b1eb57915287d',ramdisk_id='',reservation_id='r-pd7qu03z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ddc65114-90d6-462b-9bd9-b55487c264e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1418906334',owner_user_name='tempest-TestMinimumBasicScenario-1418906334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T23:09:10Z,user_data=None,user_id='1da9d6a0e8f14304b3d15b89d3d19ebc',uuid=0c4122f4-4f9c-4a95-9230-5f5224112a26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converting VIF {"id": "31f20b2e-4511-47d2-be44-a5613d90d32c", "address": "fa:16:3e:8c:1c:59", "network": {"id": "cf77e092-2341-443e-acf1-92c97e91d7a6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-70894428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e5d66722e747c98e9b1eb57915287d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f20b2e-45", "ovs_interfaceid": "31f20b2e-4511-47d2-be44-a5613d90d32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.network.os_vif_util [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1c:59,bridge_name='br-int',has_traffic_filtering=True,id=31f20b2e-4511-47d2-be44-a5613d90d32c,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f20b2e-45') {{(pid=75000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG os_vif [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1c:59,bridge_name='br-int',has_traffic_filtering=True,id=31f20b2e-4511-47d2-be44-a5613d90d32c,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f20b2e-45') {{(pid=75000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31f20b2e-45, bridge=br-int, if_exists=True) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccfc9692-86f2-45b2-8654-577777ec4da8) {{(pid=75000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:11:56 user nova-compute[75000]: INFO os_vif [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1c:59,bridge_name='br-int',has_traffic_filtering=True,id=31f20b2e-4511-47d2-be44-a5613d90d32c,network=Network(cf77e092-2341-443e-acf1-92c97e91d7a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f20b2e-45')
Nov 06 23:11:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Deleting instance files /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26_del
Nov 06 23:11:56 user nova-compute[75000]: INFO nova.virt.libvirt.driver [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Deletion of /opt/stack/data/nova/instances/0c4122f4-4f9c-4a95-9230-5f5224112a26_del complete
Nov 06 23:11:56 user nova-compute[75000]: INFO nova.compute.manager [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 06 23:11:56 user nova-compute[75000]: DEBUG oslo.service.loopingcall [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.compute.manager [-] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Deallocating network for instance {{(pid=75000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 23:11:56 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] deallocate_for_instance() {{(pid=75000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 23:11:57 user nova-compute[75000]: DEBUG nova.network.neutron [-] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Updating instance_info_cache with network_info: [] {{(pid=75000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 23:11:57 user nova-compute[75000]: INFO nova.compute.manager [-] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Took 0.45 seconds to deallocate network for instance.
Nov 06 23:11:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:11:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:11:57 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:11:57 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:11:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:11:57 user nova-compute[75000]: INFO nova.scheduler.client.report [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Deleted allocations for instance 0c4122f4-4f9c-4a95-9230-5f5224112a26
Nov 06 23:11:57 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-71cd595b-9995-475a-911e-8df8a6a8ff74 tempest-TestMinimumBasicScenario-1418906334 tempest-TestMinimumBasicScenario-1418906334-project-member] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.590s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:11:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-ea55e4ba-5aa8-401a-8ca0-d368806abc6a req-5ca4d2d0-47c8-462a-953c-b076f2de8744 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:11:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ea55e4ba-5aa8-401a-8ca0-d368806abc6a req-5ca4d2d0-47c8-462a-953c-b076f2de8744 service nova] Acquiring lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:11:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ea55e4ba-5aa8-401a-8ca0-d368806abc6a req-5ca4d2d0-47c8-462a-953c-b076f2de8744 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:11:58 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [req-ea55e4ba-5aa8-401a-8ca0-d368806abc6a req-5ca4d2d0-47c8-462a-953c-b076f2de8744 service nova] Lock "0c4122f4-4f9c-4a95-9230-5f5224112a26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:11:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-ea55e4ba-5aa8-401a-8ca0-d368806abc6a req-5ca4d2d0-47c8-462a-953c-b076f2de8744 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] No waiting events found dispatching network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 23:11:58 user nova-compute[75000]: WARNING nova.compute.manager [req-ea55e4ba-5aa8-401a-8ca0-d368806abc6a req-5ca4d2d0-47c8-462a-953c-b076f2de8744 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received unexpected event network-vif-plugged-31f20b2e-4511-47d2-be44-a5613d90d32c for instance with vm_state deleted and task_state None.
Nov 06 23:11:58 user nova-compute[75000]: DEBUG nova.compute.manager [req-ea55e4ba-5aa8-401a-8ca0-d368806abc6a req-5ca4d2d0-47c8-462a-953c-b076f2de8744 service nova] [instance: 0c4122f4-4f9c-4a95-9230-5f5224112a26] Received event network-vif-deleted-31f20b2e-4511-47d2-be44-a5613d90d32c {{(pid=75000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 23:12:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:12:03 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:12:03 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:12:03 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=24.8438720703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:12:03 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:12:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:12:07 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:07 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:09 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:09 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:12:09 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 23:12:09 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 23:12:10 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:10 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 23:12:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:12:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:12:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:12:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:12:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:12 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:14 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:15 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:15 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:12:16 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:17 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Cleaning up deleted instances {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 23:12:21 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] There are 0 instances to clean {{(pid=75000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 23:12:21 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:21 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:12:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 23:12:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:12:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 23:12:26 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:28 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:12:31 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:12:36 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:12:41 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:46 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:12:48 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:49 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:51 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:52 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:12:56 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:13:01 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:13:04 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Auditing locally available compute resources for user (node: user) {{(pid=75000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 23:13:05 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:13:05 user nova-compute[75000]: WARNING nova.virt.libvirt.driver [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Hypervisor/Node resource view: name=user free_ram=9299MB free_disk=24.881614685058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing inventories for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating ProviderTree inventory for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Updating inventory in ProviderTree for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing aggregate associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, aggregates: None {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Refreshing trait associations for resource provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da, traits: HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=75000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.compute.provider_tree [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed in ProviderTree for provider: 41c3d89d-3143-4eef-b1f4-8f3c2c4411da {{(pid=75000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.scheduler.client.report [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Inventory has not changed for provider 41c3d89d-3143-4eef-b1f4-8f3c2c4411da based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG nova.compute.resource_tracker [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Compute_service record updated for user:user {{(pid=75000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 23:13:05 user nova-compute[75000]: DEBUG oslo_concurrency.lockutils [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=75000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 23:13:06 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 23:13:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:13:08 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:13:11 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:13:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Starting heal instance info cache {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 23:13:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Rebuilding the list of instances to heal {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 23:13:11 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Didn't find any instances for network info cache update. {{(pid=75000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 23:13:11 user nova-compute[75000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 23:13:14 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:13:15 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:13:15 user nova-compute[75000]: DEBUG nova.compute.manager [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 23:13:16 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 23:13:16 user nova-compute[75000]: DEBUG oslo_service.periodic_task [None req-8827fec2-2ee8-4021-a2b3-02e74b5e317f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}